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Abstract: This work applies the theory of knowledge in distributed systems to the 

design of efficient fault-tolerant protocols. We define a large class of problems requiring 
coordinated, simultaneous action in synchronous systems, and give a method of trans- 
forming specifications of such problems into protocols that are optimal in all runs: for 
every possible input to the system and faulty processor behavior, these protocols are 
guaranteed to perform the simultaneous actions as soon as any other protocol could 
possibly perform them. This transformation is performed in two steps. In the first step, 
we extract directly from the problem specification a high-level protocol programmed us- 
ing explicit tests for common knowledge. In the second step, we carefully analyze when 
facts become common knowledge, thereby providing a method of efficiently implement- 
ing these protocols in many variants of the omissions failure model. In the generalized 
omissions model, however, our analysis shows that testing for common knowledge is 
NP-hard. Given the close correspondence between common knowledge and simultane- 
ous actions, we are able to show that no optimal protocol for any such problem can 
be computationally efficient in this model. The analysis in this paper exposes many 
subtle differences between the failure models, including the precise point at which this 
gap in complexity occurs. 
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1 Introduction 

The problem of ensuring proper coordination between processors in distributed systems 
whose components are unreliable is both important and difficult. There are generally 
two aspects to such coordination: the actions the different processors perform, and the 
relative timing of these actions. Both aspects are crucial, for instance, in maintaining 
consistent views of a distributed database. In particular, it is often most desirable to 
perform coordinated actions simultaneously at different sites of a system. It is therefore 
of great interest to study the design of protocols involving simultaneous actions, actions 
performed simultaneously by all processors whenever they are performed at all. 

This paper presents a novel approach to the design of fault-tolerant protocols. We 
begin by denning a general class of simultaneous choice problems, a class intended 
to capture the essence of simultaneous coordination in synchronous systems. Many 
well-known problems, such as simultaneous Byzantine agreement, distributed firing 
squad, etc., can be formulated as such problems. We then study the design of efficient 
protocols for such problems in a number of variants of the omissions failure model 
(cf. [MSF]). Given any satisfiable specification of a simultaneous choice problem, we 
derive a protocol for the problem with the unique property of being optimal in all runs: 
For every possible input to the system and faulty processor behavior, this protocol is 
guaranteed to perform the simultaneous actions as soon as they would be performed by 
any other protocol for the problem. (We will use optimal as shorthand for optimal in all 
runs.) In contrast, previous protocols for such problems do not adapt their behavior on 
the basis of faulty processor behavior, and hence always perform as poorly as they do in 
their worst case run. A general method of obtaining optimal protocols for simultaneous 
problems in the simpler crash failure model is implicit in the work of Dwork and Moses 
(cf. [DM]), which provided the original motivation for this work. 

Our approach is based on the close relationship between knowledge, communica- 
tion, and action in distributed systems: A number of recent works (cf. [HM], [DM], 
[Mo]) show that simultaneous actions are closely related to common knowledge. Infor- 
mally, a fact is common knowledge if it is true, everyone knows it, everyone knows that 
everyone knows it, and so on ad infinitum. Notice that every processor performing 
a simultaneous action knows the action is being performed. In addition, since such 
actions are performed simultaneously by all processors, every processor knows that 
all processors know the action is being performed. This argument can be formalized 
and extended to show that when a simultaneous action is performed, it is common 
knowledge that the action is being performed. Consequently, a necessary condition for 
performing simultaneous actions is attaining common knowledge of particular facts. 
Interestingly, our work shows that in a precise sense this is also a sufficient condition: 
The problem of performing simultaneous actions reduces to the problem of attaining 
common knowledge of particular facts. 



In deriving optimal protocols for simultaneous choice problems, we make explicit 
and direct use of the relationship between common knowledge and simultaneous actions. 
The derivation proceeds in two stages. In the first stage, we program the optimal 
protocols in a high-level language where processors' actions depend on explicit tests for 
common knowledge of certain facts. These high-level protocols are extracted directly 
from the problem specifications via a few simple manipulations. The second stage 
deals with effectively implementing these tests for common knowledge. We give a 
direct implementation of such tests in all variants of the omissions failure model we 
consider. As a result, our high-level protocols have effective implementations in these 
failure models as low-level, standard protocols that are optimal in all runs. 

Consider, for example, the following version of the distributed firing squad problem 
(cf. [BL], [CDDS], [R]): An external source may send "start" signals to some of the 
processors in the system at unpredictable, possibly different, times. It is required that 
(i) if any nonfaulty processor receives a "start" signal, then all nonfaulty processors 
perform an irreversible "firing" action at some later point, (ii) whenever any nonfaulty 
processor "fires," all nonfaulty processors do so simultaneously, and (iii) if no processor 
receives a "start" signal, then no nonfaulty processor "fires." The high-level protocol 
we derive for this problem in the omissions model requires all processors to act as 
follows: 

repeat every round 

send current view to every processor 
until it is common knowledge that 

some processor received a "start" signal; 
"fire" and halt. 

Since we exhibit an effective implementation of the test for common knowledge em- 
bedded in this protocol, this high-level protocol can be transformed into a standard 
protocol that is optimal in all runs. No previous protocol for this problem suggested in 
the literature is optimal in all runs. Furthermore, in many cases this protocol "fires" 
much earlier than any other known protocol for this problem: In some cases, this 
protocol "fires" as soon as one round after the first "start" signal is received. 

We show that optimal protocols for simultaneous choice problems can always be 
implemented in a communication efficient way, in all variants of the omissions model 
we consider. However, our direct implementation of tests for common knowledge is 
not computationally efficient: It requires processors to perform exponential time com- 
putations between consecutive rounds of communication. One of the major technical 
contributions of this paper is a method of efficiently implementing tests for common 
knowledge in several variants of the omissions failure model. In the standard omissions 
model, we provide a clean and concise method of efficiently implementing tests for com- 
mon knowledge. The analysis underlying this method reveals the basic combinatorial 



structure underlying the omissions model, as well as crisply characterizing the set of 
facts that can be common knowledge at any point in the execution of a protocol. In 
the receiving omissions model, in which faulty processors may fail to receive messages 
rather than to send messages, testing for common knowledge is shown to be trivial. 
This exposes a significant difference between two seemingly symmetric failure models. 

We are not able to efficiently implement tests for common knowledge in the gen- 
eralized omissions model, in which faulty processors may fail both to send and to 
receive messages. In fact, we show that testing for common knowledge in this model 
in NP-hard. As a result, using the close relationship between common knowledge and 
simultaneous actions, we are able to show that no optimal protocol for any reasonable 
simultaneous choice problem can be computationally efficient unless P=NP. In partic- 
ular, in this model there can be no computationally-efficient optimal protocol for the 
distributed firing squad problem stated above, for simultaneously performing Byzan- 
tine agreement (cf. [PSL], [DM]), and for most any other simultaneous problem. We 
consider another variant of the omissions model, called generalized omissions with in- 
formation, in which it is assumed that the intended receiver of an undelivered message 
can test (and therefore knows) whether it or the sender is at fault. We show that the 
techniques used in the standard omissions model extend to this model as well, yielding 
computationally-efficient optimal protocols. As a result, we see that optimal protocols 
for simultaneous choice problems are computationally intractable in the generalized 
omissions model precisely because of the fact that in this model undelivered messages 
do not uniquely determine the set of faulty processors. 

Thus, we show how to derive efficient optimal protocols in the omissions model, 
and we show that optimal protocols are intractable in the generalized omissions model. 
Since it is unrealistic to expect conventional processors (limited to polynomial-time 
computation) to follow such intractable protocols, it becomes becomes interesting to 
ask how well resource-bounded processors can perform simultaneous actions in the 
generalized omissions model. Analyzing this problem will require extending the theory 
of knowledge in distributed systems to account for the restricted computational power 
of such processors. Such an extension should give rise to notions of resource-bounded 
knowledge and common knowledge that closely correspond to the ability of resource- 
bounded processors to perform simultaneous actions. The need for a theory of resource- 
bounded knowledge has already been demonstrated, primarily by problems in which 
computational complexity is introduced by restricting the computational power of the 
adversary, thus allowing solutions involving encryption. This work, however, provides 
a more compelling indication of the need for such a theory, even for the analysis of 
simple problems in distributed computation that do not make such assumptions about 
the adversary. 

Since the role of knowledge in the design and analysis of protocols can be understood 
without delving into the details of this work, we suggest that a first reading of this 



paper be based solely on the text and statements of results. The paper is organized 
as follows: Section 2 defines the model of distributed systems used in the paper, and 
Section 3 contains precise definitions of notions of knowledge in such a system. In 
Section 4 we define the notion of a simultaneous choice problem, a large class of problems 
involving coordinated simultaneous actions. Section 5 presents a uniform method of 
deriving an optimal high-level protocol from the specification of a simultaneous choice 
problem, using explicit tests for common knowledge. Section 6 deals with the problem 
of efficiently implementing tests for common knowledge of facts relevant to simultaneous 
choice problems. The analysis in Section 6 reveals interesting properties of the different 
failure models, and exposes fine distinctions between them. Finally, Section 7 contains 
some concluding remarks. 



2 Model of a System 

This section introduces a model of the distributed systems with which this paper is 
concerned. Our treatment extends and is closely related to that of [DM]. 

We consider synchronous systems of unreliable processors. Such a system consists 
of a finite collection P = {p lt . . . ,p n } of n processors (n > 2), each pair of which is 
connected by a two-way communication link. Processors share a discrete global clock 1 
that starts at time and advances in increments of one. Communication in the system 
proceeds in a sequence of rounds, with round k taking place between time k — 1 and 
time k. Between rounds of communication a processor may perform local computation 
and other internal actions. A processor starts in some initial state at time 0. Then, in 
every following round, the processor first sends a set of messages to other processors, 
and then receives messages sent to it by other processors during the same round. In 
addition, a processor may also receive requests for service from clients external to 
the system (think, for example, of a distributed airline reservation system). Actions 
resulting from the servicing of such requests may take a variety of forms, including the 
initiation of various activities within the system by sending certain messages to other 
processors in later rounds. Each message is assumed to be tagged with the identities of 
the sender and intended receiver of the message, as well as the round in which it is sent; 
similarly for each request. At any given time, a processor's message history consists of 
the list of messages it has received from the other processors, and a processor's input 
history consists of its initial state together with the requests it has received from the 
system's external clients. A processor's view at any given time consists of its message 
history, its input history, the time on the global clock, and the processor's identity. For 



We assume the existence of a shared global clock for ease of exposition. The analysis performed in 
this paper applies even in synchronous systems in which processors have local clocks and start operating 
in an arbitrarily staggered order. 



technical reasons, it will be convenient to talk about processors' views at negative times 
(before time 0). A processor's view at a negative time is denned to be a distinguished 
empty view. 

We think of the processors as following a protocol, which specifies exactly what 
messages each processor is required to send during a round (and what other actions 
the processor is required to take) as a deterministic function of the processor's view. 
Notice that processors must compute this function by following some algorithm. Thus, 
while we formally define a protocol to be a function, it is convenient to maintain both 
views of a protocol as a function and an algorithm. While a protocol determines the 
behavior of each processor (as a function of its view), processors are unreliable and 
some of them may be faulty, the rest being nonfaulty. Both faulty and nonfaulty 
processors faithfully follow the protocol, their behaviors differing only in the messages 
they successfully send and receive. 2 A nonfaulty processor sends every message it 
is required by the protocol to send, and receives every message sent to it by other 
processors, in all rounds of communication. A faulty processor, however, may fail to 
send or receive certain messages; a processor is said to fail during a given round if 
it fails to send or receive a message during that round. We will consider a number of 
different processor failure models: (i) the omissions model (cf. [MSF]), in which a faulty 
processor receives every message sent to it, but sends only an arbitrary (not necessarily 
strict) subset of the messages it is required to send; (ii) the receiving omissions model, 
in which a faulty processor sends every message it is required to send, but receives only 
an arbitrary subset of the messages sent to it; (iii) the generalized omissions model, 
in which a faulty processor may both send only an arbitrary subset of the messages 
it is required to send and receive only an arbitrary subset of the messages sent to 
it; and (iv) generalized omissions with information, which differs from the generalized 
omissions model in that a processor not receiving a message from another processor 
can determine whether it or the sender is at fault. 

An infinite execution of a protocol in a system is called a run of the protocol. We 
identify a run with the complete history of events that take place during the run, from 
time until the end of time. This includes each processor's complete input history, 
complete message history, and, if the processor is faulty in the run, a description of 
its behavior during each round (formalized in the following paragraph). A pair (p,£), 
where p is a run and £ is a natural number, is called a point, and represents the state 
of the system after the first t rounds of p. We denote processor g's view at the point 
[p,t) by v {q,p,l). 

We now define the notion of a failure pattern, a formal description of faulty pro- 
cessor behavior during a run. The notion of a failure pattern in each variant of the 

Intuitively, processors attempt to send and receive all required messages. Failures are caused by 
faulty input /output ports. However, we will often speak of processors failing to send or receive a given 
message when we mean that the message was not successfully sent or received, respectively. 



omissions model is a suitable restriction of this general definition. Remember that a 
faulty processor may fail to send or receive certain messages. It is therefore natural to 
define the faulty behavior of a processor p to be a pair of functions S and R mapping 
round numbers to sets of processors. Intuitively, these are the processors to which p 
fails to send and receive messages, respectively, during each round. The processor p is 
said to display this faulty behavior during a given run if in every round k processor p 
sends no messages to processors in S (k) but sends all required messages to processors 
not in S (k), and receives no messages from processors in R(k) but receives all messages 
sent to it by processors not in R(k). The failure pattern of a run is a set of pairs 
{Pi,{ s i>Ri}) consisting of a processor and a faulty behavior, such that the processors 
appearing in the failure pattern are exactly those that are faulty in the run, and each 
displays the corresponding faulty behavior. Given a run p, if 7,- is the complete input 
history of processor p, in p, then we say that 7 = (7 l5 . . . ,7„) is the (external) input 
to p. A pair (^,7), where ir is a failure pattern and 7 is an input, is called an operating 
environment. Notice that a run is uniquely determined by a protocol and an operating 
environment. Two runs of two different protocols are said to be corresponding runs if 
they have the same operating environment. The fact that an operating environment is 
independent of the protocol will allow us to compare different protocols according to 
their behavior in corresponding runs. 

In this work, we study the behavior of protocols in the presence of a bounded 
number of failures (of a particular type) and a given setting of possible inputs. It 
is therefore natural to identify a system with the set of all possible runs of a given 
protocol under such circumstances. Formally, a system is identified with the set of 
runs of a protocol P by n > 2 processors, at most t < n — 2 of which may be faulty 
(in the sense of a particular failure model M), where the complete input history of 
each processor p, is an element of a set I\. We denote this set of runs by the tuple 
£ = (n,t,P,M,Ti, . . . ,r n ). Our definition of a system ensures that the input to the 
system is orthogonal to, and hence carries no information about, the failure pattern. In 
addition, since the set of possible inputs in the system has the form Ti x ■ • ■ x r n , one 
processor's input contains no information about any other processor's input, and hence 
the only way in which processors obtain information about other processor's input is 
via messages communicated between the processors in the system. 

While a protocol may be thought of as a function of processors' views, protocols 
for distributed systems (as well as protocols for sequential and parallel computation) 
are typically written for systems of arbitrarily large size. In this sense, the actions 
and messages required of a processor by a protocol actually depend on the number 
of processors in the system (and perhaps the bound on the number of failures) as 
well as the view of the processor. Therefore, we formally define a protocol to be a 
function from n, t, and a processor's view to a list of actions the processor is required 
to perform, followed by a list of messages the processor is required to send in the 



following round. Since each protocol is defined for systems of arbitrary size, it is natural 
to define a class of systems to be a collection of systems {E(re, t) : n > t + 2 > 0}, where 
E(n,i) = (n,t,P, .M,ri,...,r„) for some fixed protocol P, failure model M, and input 
sets T,-. 



3 Definition of Knowledge 

Our analysis makes essential use of reasoning about processors' knowledge at various 
points in the execution of a protocol. This section contains precise definitions of the 
notions of knowledge we use. For the purpose of these definitions, we assume that a 
particular system, a set of runs as defined in the previous section, is fixed ahead of 
time. All runs mentioned will be runs of this system, and all points will be points in 
such runs. Our treatment is a modification of that of [DM] and [HM]. 

We assume the existence of an underlying logical language for representing all rel- 
evant ground facts — facts about the system that do not explicitly mention proces- 
sors' knowledge (for example, ''the value of register x is 0", or "processor p,- failed in 
round 8"). Formally, a ground fact <p will be identified with a set of points r(<p). A 
ground fact <p is said to hold at a point (p,t), denoted (p,£) |= (p, iff (p,£) e r(<p). 
We will define various ground facts as we go along. The set of points corresponding to 
these facts will be clear from context. A fact is said to be valid if it is true of all points 
in all systems. A fact is said to be valid in the system for a given system if it is true of 
all points in the system. 

We now define what facts a processor is said to "know" at any given point (p, £) in 
the system. Roughly speaking, a processor p, is said to know a fact <p if <p is guaranteed 
to hold, given p,'s view of the run. More formally, we say p,- knows <p at {p,k), denoted 
{p,k) |= Ki<p, if (p',k) \= <p for all points (p',k) satisfying v(p { ,p,k) = v(pi,p',k). 
This definition of knowledge is essentially the total view interpretation of [HM]. It is 
"external," in the sense that a processor is ascribed knowledge based solely on the 
processor's information, and not, say, on the local computation it performs or on its 
computational power. Notice that a processor's knowledge at a given point depends on 
the system as well as on the specific run. Thus, implicit in the definition of (p,£) |= (p 
is the system relative to which knowledge is determined. Throughout the paper it will 
be clear from context what the relevant system should be whenever "|=" is used. 

We will find it useful to extend this definition of knowledge to sets of processors as 
well. The view of a set of processors GCPat {p,k), denoted v(G,p,k), is defined by: 

v(G,p,k) d ^ f {v(p,p,k) : P eG}. 

Thus, roughly speaking, G's view is simply the joint view of its members. We say 
that the group G implicitly knows tp at (p, k), denoted (p,k) \= I a (p, if for all points 



(p',k) satisfying v{G,p,k) = v(G,p',k) it is the case that (p',k) (= <p. In the particular 
case that G is the singleton set {p,}, the notions of I a and K { coincide. Intuitively, G 
implicitly knows ip if the joint view of G's members guarantees that <p holds. Notice 
that if processor p knows <p and processor q knows <p D tp, then together they implicitly 
know ip, even if neither of them knows ip individually. The notion of implicit knowledge 
was first defined in [HM]. 

The notions of knowledge and implicit knowledge denned above are closely related 
to modal logics that have been extensively studied by philosophers (cf. [Hi]). We say 
that an operator M has the properties of the modal system S5 if it satisfies a) if <p is 
valid in the system then M<p is valid in the system; and the following formulas are valid: 
b) M<p D <p; c) (Mip A M(<p D ip)) D Mip\ d) Mtp D MM<p; and e) -^Mtp ^ M->M<p. 
The definitions of knowledge and implicit knowledge given above immediately imply 
the following (cf. [HM2], [DM]): 

Proposition 1: The operators K { and I a each has the properties of S5. 

Finally, the state of common knowledge among a group of processors will be central 
to our analysis. It's central role will result from the close correspondence between 
common knowledge among the members of a group and simultaneous actions performed 
by the group. Roughly speaking, as we mentioned in the introduction, a fact <p is 
common knowledge to a given group if <p holds, everyone in the group knows <p, everyone 
knows that everyone knows <p, and so on ad infinitum. Formally defining common 
knowledge, however, must be done with great care. The problem is that the groups 
of interest are not always explicitly given as fixed subsets of P. For example, we will 
be most interested in facts that are common knowledge to the group M of nonfaulty 
processors. In any given context (in this case, any given run), this group is a fixed 
set of processors. But the precise identity of M varies from one context to another. 
This motivates us to define common knowledge to a slightly more general notion of 
groups of processors: An indexical set S of processors is a function mapping points 
to sets of processors. That is, S : (/>,£) ■-► S{p,t), where S(p,£) C P. The notion of 
an indexical set is a direct generalization of the notion of a fixed set of processors. 
In particular, we can identify a fixed set of processors with a constant indexical set. 
The group M of nonfaulty processors, the group P of all processors, the group of all 
processors that haven't displayed faulty behavior by the current time, and many other 
groups of interest are all indexical sets of processors. 

The first step in defining common knowledge to a given group of processors is to 
determine what it means for everyone in the group to know a fact. For a fixed set G, 
"everyone in G knows <p," denoted E G <p, is customarily defined by E a <p = A Knp 

Pi€G 

(cf. [HM]). In extending this notion to indexical sets, however, a subtle decision must 



be made. The immediate generalization of this definition is to define E s ip = A Ki<P- 

This generalization, however, does not yield a notion of common knowledge that closely 
corresponds to S's ability to perform simultaneous actions (see Lemma 4 below). Given 
that G is a fixed set, and that the knowledge operator K { satisfies property (a) of S5 
given above, it follows that p, e G = Ki(pi 6 G) is valid. Therefore, an equivalent 
definition of E G <p is E a <p = A #,(p, e G Dp). We choose this form of "everyone 

knows" as the appropriate generalization to indexical sets. Formally, given an indexical 
set S, we define E s <p, essentially corresponding to everyone in S knows tp, by: 



E s <p d ^ /\ Ki{ Pi eS D tp). 
Pies 

Roughly speaking, E s (p holds exactly if every member of S knows that, if it is a member 
of S, then <p holds. 

We now define tp is common knowledge to S, denoted C s <p, by: 

def 

C s (p = tp A E s <p A E s E s <p A ■ • • A E™tp A • • • . 

In other words, (p,i) \= C s <p iff both (/>,£) |= <p and for all m > 1 it is the case 
that (p, £) (= E™<p. Thus, roughly speaking, a fact is common knowledge if it is true, 
everyone knows it, everyone knows that everyone knows it, etc. The definitions of E s 
and C s directly generalize the standard notions from [HM] and [DM]. 

A useful tool for thinking about E™<p and C s <p is an undirected graph whose nodes 
are the points of the system, in which two points (p, k) and (p 1 , k) are connected by an 
edge iff some processor p that is a member of both S(p, k) and S{p',k) has the same 
view at both (p,k) and (p',k). This graph is called the similarity graph relative to S. 
For example, if S is the set M of nonfaulty processors, two points are connected by an 
edge in the similarity graph iff there is a processor that is nonfaulty at both points, 
and has the same view at both points. An easy argument by induction on m shows 
that {p,k) |= E™<p iff (p',k) (= ip for all points (p\k) of distance at most m from 
[p,k) in this graph. It follows that {p,k) \= C M <p iff (p',k) [= <p for all points {p',k) in 
the connected component of (p,k). Two points (/>,£) and (/?',£) are said to be similar 
relative to S, denoted (p,£) ~ (p',t), if they are in the same connected component of 
the similarity graph. Since the indexical set S is generally clear from context (most 
often being the set M of nonfaulty processors), we denote similarity by ~ without the 
superscript S. We thus have: 

Theorem 2: (p, k) (= C s <p iff (/>', A;) (= <p for all points (p 1 , k) satisfying {p, k) ~ (/>', k). 

Our analysis will exploit this relationship between common knowledge and the similar- 
ity graph. The similarity graph will provide us with a useful combinatorial tool with 
which to study when facts become common knowledge. 



One of the useful properties of common knowledge is the so-called "fixpoint axiom" 
(cf. [HM]) 

C s (p = E s C s <p, 

which states that common knowledge is a fixpoint of the E s operator (provided S is 
nonempty, as will invariably be the case in this work). It implies that a fact's being 
common knowledge is in a sense "public:" a fact can be common knowledge to a group 
of processors only if all members of the group know that it is common knowledge. This 
axiom also implies that when a fact becomes common knowledge, it becomes common 
knowledge to all relevant processors simultaneously. Another useful fact about common 
knowledge is captured by the following induction rule: 

If <p D E s <p is valid in the system, 

then ip D C s ip is valid in the system. 

Roughly speaking, the induction rule implies that if a fact is "public" to a group 
of processors, in the sense that whenever it holds it is known to all members of the 
group, then whenever it holds it is in fact common knowledge. These are two essential 
properties of common knowledge that will prove useful to our analysis. In addition, we 
can also show the following: 

Proposition 3: The operator C s has the properties of S5. 

According to our definitions, facts about the system are properties of points: they 
are either true or false at any given point. It is often useful to be able to refer to facts 
as being about things other than points (e.g., properties of runs). In general, a fact <p 
is said to be a fact about X if fixing X determines the truth (or falsity) of <p. For 
example, a fact <p is said to be a fact about the input if fixing the input determines 
whether or not <p holds. That is, for any given input 7, either <p holds at all points 
(p, k) where p is a run with input 7, or <p holds at no such point. The meaning of a fact 
being about the operating environment, about the existence of failures, about the first k 
rounds, etc., are similarly defined. 



4 Simultaneous Choice Problems 

In order to study in a uniform and general way the design of protocols for problems 
involving coordinated simultaneous action, a definition of this class of problems is 
required. Lacking a most general definition, we focus on the class of simultaneous 
choice problems, a large class of problems that capture the essence of such coordinated 
action in a distributed environment. Roughly speaking, these problems require that 
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one of a number of alternative actions be performed (or "chosen") simultaneously by 
the nonfaulty processors, where for each action we are given conditions under which 
the action must be performed and conditions under which its performance is forbidden. 
In addition, the specification of such a problem also determines the possible operating 
environments, by specifying what inputs each processor may possibly receive and what 
types of processor failures are possible. 

Formally, a simultaneous action a is an action having two associated conditions 
pro(a) and con(a), both facts about the operating environment. A simultaneous choice 
problem C is a problem determined by a set {a^... ,a m } of simultaneous actions and 
their associated conditions, together with a failure model M, and a set Tj of complete 
input histories for each processor pj. Intuitively, we will require that every run p of a 
protocol implementing C satisfies the following conditions: 

(i) each nonfaulty processor performs at most one of the a,'s, 

(ii) any a, performed by some nonfaulty 3 processor is performed simultaneously by 
all of them, 

(iii) a, is performed by all nonfaulty processors if p satisfies profa), and 

(iv) a, is not performed by any nonfaulty processor if p satisfies con{ai). 

More formally, a protocol P and the simultaneous choice C determine a class of systems 
{E(n,t) :n>t + 2}, where £(n,<) = [n,t,P ,M,T U . . . ,T n ). We say that P imple- 
ments C if every run of every system in the class determined by P and C satisfies the 
conditions (i)-(iv) above. A simultaneous choice problem is said to be implementable 
(or satisfiable) if there is a protocol that implements it. 

In addition to simultaneous choice problems, we also consider the closely related 
class of strict simultaneous choice problems. Both classes are specified in essentially 
the same way, except that runs of a protocol implementing a strict simultaneous choice 
are required to satisfy the modified condition 

(i') each nonfaulty processor performs exactly one of the a t 's, 

together with conditions (ii)-(iv) above. All of the results in this paper hold for strict 
simultaneous choice problems as well as simultaneous choice problems, and henceforth 
we will typically mention only simultaneous choice problems explicitly. 

We have chosen the set M of nonfaulty processors as the set of processors required to perform actions 
simultaneously, but the notion of a simultaneous choice problem may be stated in terms of many other 
similar (indexical) sets of processors, including the set P of all processors, with the analysis in this 
section and the next one carrying through without change. 

11 



Having formally defined simultaneous choice problems (and strict simultaneous 
choice problems), let us consider when the specification of such a problem disallows 
performing a simultaneous action a,. Clearly, if con(a { ) holds then performing a, is dis- 
allowed. In addition, since by condition (i) no more than one action may be performed 
by the nonfaulty processors in any given run, the condition pro(aj), for some j ^ t, 
requires a, to be performed, and hence also disallows a,. It is easy to see that these 
are the only conditions under which performing a,- is disallowed. This motivates the 
following definition: 

enabled^) = -iconfa) A f\ ->pro[aj). 

Our discussion above implies that the performance of an action a, is allowed by the 
problem specification iff the condition enabled^) is satisfied. Notice that it is possible 
for several of the conditions enabled^) to hold at once, in which case performance 
of any of the enabled actions is allowed by the problem specification. In addition, it 
is easy to see that the formulas confa) D ->ena6/ed(a.) and pro(ai) D ^enabled{aj) 
(j ^ i) are valid in any system in which processors follow a protocol implementing a 
simultaneous choice. Finally, notice that because the conditions profa) and con(aj) 
are facts about the operating environment, so is each condition enabled(a,i). 

The definition of a simultaneous choice problem is fairly abstract. Many familiar 
problems requiring simultaneous action by a group of processors are instances of a 
simultaneous choice or strict simultaneous choice. In all known cases, the conditions 
pro(ai) and confa) are facts about the input and the existence of failures. (By the exis- 
tence of failures we mean whether any failure whatsoever occurs during the run. Some 
problems allow the nonfaulty processors to display default behavior in the presence of 
failures; cf. [LF].) For example, the distributed firing squad problem is a simultane- 
ous choice consisting of a single "firing" action a, with the condition pro(a) being the 
receipt of a "start" signal by a nonfaulty processor, and the condition con(a) being 
that no processor receives a "start" signal. The condition enabled{a) is simply that 
some processor receives a "start" signal. Each set Ty of possible inputs simply allows 
for a "start" message to be delivered to any processor at any time. The simultaneous 
Byzantine agreement problem (cf. [DM], [PSL]) is an example of a strict simultaneous 
choice. This problem consists of an action a of "deciding 0" and an action a x of "de- 
ciding 1." Each set Tj of possible inputs consists of two possible inputs: one starting 
with initial value and receiving no further external input during the run, and the 
other starting with initial value 1. The condition pro(a ) is that all initial values are 0, 
and the condition pro{a x ) is that all initial values are 1. The conditions con(a ) and 
con(ax) are both taken to be false. Here the condition enabled(a ) is that some initial 
value is 0, and the condition enabled(a 1 ) is that some initial value is 1. Since for most 
assignments of initial values both enabled(ao) and enabled{a x ) hold, it is typically the 
case that deciding either or 1 is acceptable. Simultaneous Byzantine agreement is 
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a strict simultaneous choice, since the processors are required to decide either or 1 
in every run. Other related problems that may also be formulated as (strict) simulta- 
neous choice problems include weak Byzantine agreement and the Byzantine Generals 
problem (cf. [F]). 

Having formally defined the notion of a simultaneous action, we are now in a position 
to carefully state the relationship between simultaneous actions and common knowledge 
mentioned in the introduction: When a simultaneous action is performed, it is common 
knowledge that the action is being performed. The statement we actually prove is that 
when such an action is performed, it is common knowledge that the action is enabled. 

Lemma 4: Let p be a run of a protocol implementing a simultaneous choice C. If 
the action a,- of C is performed by a nonfaulty processor at time I in p, then (p, £) |= 
C M enabled(a,i). 

Proof: Let <p be the fact "a,- is being performed by a nonfaulty processor." A 
processor pj performing the action a, clearly knows that it is performing a,. This 
processor therefore also knows that if it is nonfaulty then a, is being performed by a 
nonfaulty processor. Since p is a run of a protocol implementing C, the action a, is 
performed simultaneously by all nonfaulty processors whenever it is performed by a 
single nonfaulty processor. It follows that whenever <p holds, so does E M <p, and hence 
<p D E M <p is valid in the system. The induction rule implies that (p D C M <p is valid in 
the system as well. Notice that <p D enabled^) is valid in the system. It thus follows 
that C M tp D C M enabled(ai) is valid in the system, and hence so is (p D C M enabled(ai). 
Thus, (/>,£) |= tp implies (p,£) (= C M enabled(a.i), and we are done. D 

In the above proof, the essential fact that ip D E M ip is valid in the system depends 
crucially on our definition of E M <p. A processor p performing a,- knows that a, is being 
performed, but since a nonfaulty processor might not know that it is nonfaulty, p 
might not know that a, is being performed by a nonfaulty processor. The processor p 
does know, however, that if it (p itself) is nonfaulty, then a nonfaulty processor is 
performing a,. It is for this reason that we have been led to choose our definition 
of E M (p as we have, as discussed in the previous section. 



5 Optimal Protocols 

In this section, we show how to extract a high-level optimal protocol for a simultaneous 
choice problem directly from its specification. We begin by considering a simple class 
of protocols that will serve as a building block in the design of such optimal protocols. 
Recall that a protocol is a function specifying the actions a processor should perform 
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and the messages it should send as a function of n, t, and the processor's view. Thus, 
we can think of a protocol as having two components: an action component and a 
message component. A protocol is said to be a full-information protocol (cf. [Ha], [FL], 
[PSL]) if its message component is: 

repeat every round 

send current view to all processors 
forever. 

Intuitively, since such a protocol requires that all processors send all of the information 
available to them in every round, one would expect this protocol to give each processor 
as much information about the operating environment as any protocol could. In par- 
ticular, the following result shows that if a processor cannot distinguish two operating 
environments during runs of a full-information protocol, then the processor can not 
distinguish these operating environments during runs of any other protocol. 

Lemma 5: Let p and p' be runs of a full- information protocol 7, and let f and f' 
be runs of an arbitrary protocol P corresponding to p and p', respectively. For all 
processors q and times £, if v(q,p,£) = v(q,p',l) then v(q,$,£) = v(q, $',£). 

Proof: We proceed by induction on the time £. The case of £ — is immediate 
since q must have the same initial state in both p and p' , and hence also in f and f'. 
Suppose £ > and the inductive hypothesis holds for all processors p at time £ - 1. 
The view of q at time £ is determined by its view at time £ - 1, the (external) input it 
receives during round £, and the messages it receives during round £. Since q has the 
same view at time £ - 1 in p and p', by the inductive hypothesis, the same is true in f 
and f'. Since q receives the same input during round £ in p and p', the same is true 
in f and £'. If q does not receive a message from p during round £ in p and p', then 
both operating environments determine that no message from p to q during round £ is 
delivered. Thus, q does not receive a message from p during round £ in either f or f'. 
If q does receive a message from p during round £ in p and p', then both operating 
environments determine that any message from p to q during round £ is delivered. If 
q receives a message from p during round £ of p and p', then since q must receive the 
same message from p in both p and p', the view of p must be the same at time £ - 1 
in p and p'. By the inductive hypothesis, p's view at time £ - 1 must also be the same 
in f and f'. Since P is a deterministic function of a processor's view, q receives the 
same messages from p during round £ in f and <;'. Thus, q has the same view at time £ 
in f and f\ □ 

Thus, roughly speaking, processors learn the most about the operating environment 
during runs of full- information protocols. The following corollary of Lemma 5 shows 
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that facts about the operating environment become common knowledge during runs of 
such protocols at least as soon as they do during runs of any other protocol. This result 
captures in a precise sense a property of full-information protocols that is essential to 
our analysis. 

Corollary 6: Let p be a fact about the operating environment. Let p and f be 
corresponding runs of a full-information protocol 7 and an arbitrary protocol P, re- 
spectively. If (f,£) f= C M <p then (p,£) \= C M <p. 

Proof: Suppose that ($,l) |= C M (p, and suppose that (/>,£) ~ (/>',£) for some run p' 
of 7. Let f' be the run of P corresponding to p'. Lemma 5 and a simple inductive 
argument on the distance between (p,t) and (p',£) in the similarity graph show that 
{p,i) ~ (p',£) implies (f,£) ~ (f',£). Since (f,£) (= C M <p, we have (f',£) (= tp. Since 
corresponding runs satisfy the same facts about the operating environment, (f',£) |= <p 
implies (p 1 ,£) \= <p. It follows that (p,£) f= C M (p. □ 

We are now in a position to describe how to construct optimal protocols for si- 
multaneous choice problems. Recall that when a simultaneous action a t - is performed, 
Lemma 4 implies that enabled^) must be common knowledge. Since enabled^) is 
a fact about the operating environment, Corollary 6 implies that enabled(di) becomes 
common knowledge in runs of a full-information protocol as soon at it does in corre- 
sponding runs of any other protocol. Thus, given an effective test that the nonfaulty 
processors can use to determine whether enabled(ai) is common knowledge, a test we 
denote by test-for-C M enabled(ai), the following protocol 7 C is an optimal protocol for C: 

no-action-performed <— true; 
repeat every round 

if no.action.performed and test-for-C M enabled(a,i) returns true for some a,- 
then 

j *— min{i : test-for-C M enabled(a{) returns true}, 
perform a,, 

no -actiori-per formed <— false; 
send current view to every processor; 
forever. 

Before formally proving that 7 C is an optimal protocol, we must define the tests for 
common knowledge that appear in 7 C more formally. Recall that the fixpoint axiom 
implies C M <p D E M C M <p is valid. This guarantees that C M ip follows from the view of 
each nonfaulty processor whenever C M <p holds. Notice, that C M ip is not guaranteed to 
follow from the view of a faulty processor. It is therefore natural to define a test for 
common knowledge of <p, denoted as above by test-for-C M tp, to be a test that, given 
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the view of a nonfaulty processor at (/>,£) (together with n and t), returns true iff 
C M ip holds at (p,£). Such a test may return either true or false when given the view 
of a faulty processor. Let us denote by Aj{p,£) the set of actions a, such that test- 
for-C M enabled(ai) returns true when given the view of pj at (p,£). Notice that if p } - is 
nonfaulty, then Aj(p,l) is precisely the set of action a,- such that C yi tnabltd{a i ) holds 
at (/?,£). It follows that for all nonfaulty processors py the sets Aj are equal at all 
times. In particular, all become nonempty at the same time (as soon as enabltdfa) 
becomes common knowledge for some a,). Thus, if all processors p, choose the action 
of least index from Aj as soon as this set becomes nonempty, as required by 7 C , then all 
nonfaulty processors choose the same action simultaneously. We can now prove that 7 C 
is an optimal protocol for C. 

Theorem 7: If C is an implementable simultaneous choice problem, then 7 C is an 
optimal protocol for C. 

Proof: We first prove that nonfaulty processors perform actions in runs of 7 C as soon 
as they do in corresponding runs of any protocol implementing C. Let p be a run of 7 C , 
and let f be the corresponding run of a protocol implementing C. Lemma 4 implies that 
if a,- is performed by a nonfaulty processor at time £ in f, then (f,£) |= C M enabled^) . 
Since enabledfa) is a fact about the operating environment, Corollary 6 implies that 
(p,t) \= C M enabled(ai). As a result, Aj(p,£) must be nonempty for all nonfaulty proces- 
sors pj, and hence each must perform an action in p no later that time £. It follows that 
nonfaulty processors perform actions in runs of 7 C as soon as they do in corresponding 
runs of any protocol implementing C. We now show that 7 C actually implements C. 
Let p be a run of 7 C . First, it is obvious from the definition of 7 C that each non- 
faulty processor performs at most one action in p. (If C is an implementable strict 
simultaneous choice, then the preceding discussion shows that the nonfaulty processors 
perform exactly one action in p.) Second, if a nonfaulty processor pj performs an ac- 
tion a,- at time £ during p, then time £ is the first time at which Aj(p,k) is nonempty, 
and a, is the action of least index in this set. Since Aj(p,k) = A m {p,k) for all non- 
faulty processors p m , the same is true for all nonfaulty processors. As a result, all 
nonfaulty processors must choose to perform a, simultaneously at time £. Third, if 
p satisfies profa), then the run f of any protocol implementing C corresponding to p 
must satisfy profa), and hence a,- must be performed in f. As we have already seen, an 
action must also be performed in p. Since pro(di) I> -<enabled(aj) for all j ^ i, the set 
Aj {p, k) of a nonfaulty processor pj must contain no action other than a,- (if it contains 
any action at all). Thus, a,- must be the action performed in p. Finally, if p satisfies 
con(ai), then p does not satisfy enabled^), and no set Aj(p,£) of a nonfaulty proces- 
sor pj contains a,-. Thus, a t - is not performed in p. It follows that 7 C implements C. 

□ 
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b. 9i{p,3) 



Figure 1: Communication graphs. 



As a result of Theorem 7, we see that full-information protocols can be used as the 
basis of optimal protocols for simultaneous choice problems. Thus, we will restrict our 
attention to full-information protocols in the remainder of this paper: unless otherwise 
specified, all protocols mentioned will be full-information protocols, and all runs will 
be runs of such protocols. More importantly, however, a consequence of Theorem 7 
is that designing an optimal protocol for a simultaneous choice problem C essentially 
reduces to testing for common knowledge of certain facts: In order to design an optimal 
protocol for C, it is enough to construct the tests for common knowledge of the facts 
enabltd{ai) ■ We note that the fundamental property of common knowledge underlying 
the existence of such tests is the fact that C M ip D E M <p is valid; that is, when <p becomes 
common knowledge, the fact that tp is common knowledge will follow from the view of 
every nonfaulty processor. The problem of implementing such tests is the subject of 
the following section. 

Before ending this section, however, we consider the size of messages required by 
a full-information protocol 7. Such a protocol requires processors to send their entire 
view during every round. Since, strictly speaking, a processor's view may be exponen- 
tial in size, this protocol seems to require processors to send messages of exponential 
length. We now show, however, that there is a simple, compact representation of a 
processor's view that may be sent instead. Consequently, it will be possible to im- 
plement all full-information protocols (and in particular the optimal protocol I c ) in a 
communication-efficient way in all variants of the omissions model. 

Given a run p of J , the communication graph of p (see Figure 1; cf. [Me]) represents 
the messages delivered in p. It is a layered graph (with one layer corresponding to 
every natural number, representing time on the global clock) in which each processor 
is represented by one node in every layer. We denote the node representing processor p 
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at time £ by (p,£). Edges connect nodes in adjacent layers, with an edge between 
(p, k — 1) and (q, k) iff a message from p is delivered to q during round k. The labeled 
communication graph is obtained by labeling the layer nodes of the communication 
graph with processors' names and initial states, and by labeling the layer k nodes (for 
k > 0) with requests the processors receive from external clients during round A;. For 
every point (p, £), we denote by £(/>, £) the first £+1 layers of the labeled communication 
graph of p, representing the first £ rounds of p. For example, illustrated in Figure 1(a) 
is a graph Q(p, 3) depicting the first 3 rounds of a run p. We say that Q{p,t) has 
length £. We note in passing that in runs of the full- information protocol 7, the labeled 
communication graph uniquely determines the operating environment. 

Informally, at every point (p,£) of a run of J, a processor p.'s view corresponds to 
a certain subgraph £,(p,£) of £(p,£). For example, the subgraph £i(p,3) of £(p,3) 
is illustrated in Figure 1(b). We define the subgraph £,(/>,£) of £(p,£) inductively 
as follows. For £ = the subgraph Qi{p,Q) consists of the labeled node (p,-,0). For 
£ > the subgraph £,(p,£) consists of the labeled node (p<,£), the edges from (p,-,£) to 
layer £ - 1 nodes, and the subgraphs Qj{p,L - 1) for every layer £ - 1 node (p ; -,£ - 1) 
adjacent to (p,-,£). Given a set S of processors, it is convenient to denote by Qs{p,£) 
the subgraph of £(/?,£) consisting of the union of the graphs £,(/>,£) for every Pi € S. 
We remark that Qs{p,t) uniquely determines £,(/>,£) for every p, E S. The next lemma 
states that a processor's view of the labeled communication graph uniquely determines 
its view of the run. 

Lemma & Let p and p' be runs of a full-information protocol /. For every processor p,- 
and time £, i>(p,-,p,£) = v{ Pi ,p',£) iff £,(p,£) = £,(//,£). 

Proof: We proceed by induction on £. The case of £ = is immediate. Suppose 
£ > and the inductive hypothesis holds for £ — 1. 

Suppose pi has the same view at time £ in both p and p' . This implies, in particular, 
that pi has the same view at time £— 1 in p and p', and from the inductive hypothesis it 
follows that Qi{p,l — 1) = Qi{p',l — 1). In addition, this implies that p, must receive the 
same input during round £ in p and p', and hence (p,-,£) is labeled with the same input 
i n 9i{p^) an( i Q\{p' ■>£)• If Pi does not receive a message from a processor p 3 - during 
round I in p and p', then there is no edge from (py,£ - 1) to (p<,£) in either Qi{p,t) or 
Qi{p' , £). If Pi does receive a message from a processor p, during round £ in p and p', then 
it receives the same message in both runs and p, must have the same view at time £ — 1 
in both runs. Hence, there is an edge from (pj,£- 1) to (pi,£) in both £,(p,£) and 
Qi{p',l), and by the inductive hypothesis we have that $j{p,t — 1) = Qj{p',L - 1). 
Thus, 9 i {p,l)=9 i {p',l). 

Conversely, suppose Qi{p,l) = Qi{p',L)- It follows that Qi{p,L- 1) = £,-(p',£ - 1), 
and by the inductive hypothesis p,- has the same view at time £ — 1 in p and p'. The 
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node (p,-,£) must be labeled with the same input in £,(/>,£) and £,(p',£), so p, receives 
the same input during round £ in p and p'. The edges from layer £ - 1 nodes to (pi,£) 
are the same in £,(/>,£) and Si{p',l), so p, receives messages from the same processors 
during round £ in p and p'. Again, &(p,£ - 1) = Qj{p',L- 1) for every node (p,-,£ - 1) 
adjacent to (p,-,£), and by the inductive hypothesis p, has the same view at time £ — 1 
in p and p'. Hence, p,- receives the same messages during round £ in p and p' . It follows 
that p,- has the same view at time £ in both p and p'. □ 

Consequently, a processor's view of the run and a processor's view of the correspond- 
ing labeled communication graph convey the same information: Given either the graph 
Qx(pA) or the view u(p,-,p,£), reconstructing the other is straightforward. Therefore, 
an equivalent implementation of a full-information protocol requires the processors to 
send the labeled communication graphs corresponding to their views instead of sending 
their complete views. From now on, we will use the term full-information protocol to 
refer to this equivalent form. It is easy to see that the size of £,(p,£) is polynomial in 
the number of processors n, the global time £, and the size of the requests received from 
external clients. It follows that messages required by a full-information protocol are of 
polynomial size. 4 Furthermore, given the labeled communication graphs corresponding 
to the views at time £ — 1 of the processors that send messages to a given processor p,- 
during round £, it is easy to construct the labeled communication graph corresponding 
to the processor's view at time £. Thus, the use of such compact representations of a 
processor's view is computationally efficient as well as communication efficient. Finally, 
recall that we have formally defined a test for common knowledge to be a function of 
processor views (as well at n and t) . In light of the preceding discussion, there is no 
loss of generality in assuming that such a test is a function of communication graphs 
corresponding to processor views. We now turn to the problem of implementing such 
tests. 



6 Testing Common Knowledge 

The previous section established the claim that tests for common knowledge provide 
a very powerful programming technique: The design of optimal protocols for simulta- 
neous choice problems reduces to implementing tests for common knowledge of certain 
facts. In this section we investigate the problem of implementing tests for common 
knowledge in the different variants of the omissions model. With such tests, we will be 
able to construct optimal protocols for simultaneous choice problems in these models. 
As we will see, properties of the different variants of the omissions model cause dra- 
matic differences in the complexity of testing for common knowledge. In addition, the 



In the Byzantine failure models in which processors are allowed to lie (or maliciously deviate from 
the protocol), however, such compact representations are not guaranteed to exist; cf. [C]. 
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optimal protocols we construct will have interesting properties that vary according to 
the failure model. 

Recall that a protocol is a function that, given the number of processors n, the 
bound t on the number of faulty processors, and a processor's view, yields a list of the 
actions the processor should perform, as well as the messages it should send in the next 
round. (Thus, the protocols we are interested in are uniform in n and t.) Since the 
protocols we will be concerned with are full-information protocols, processors' views 
will be efficiently representable by labeled communication graphs. We will soon restrict 
our attention to simultaneous choice problems in which the external requests are of 
constant size. This restriction implies that processors' views at time £ will be of size 
polynomial in n and I. A protocol will therefore determine the messages and actions 
required at time I based on input of size polynomial in n and L Consequently, we will 
measure the complexity of computations performed by protocols at time t in systems 
of n processors as a function of n and t: By polynomial time, polynomial space, etc., 
we will mean polynomial in n and t. 

The definition of simultaneous choice problems presented in Section 4 is very general. 
So general, in fact, that it is possible to define simultaneous choice problems with a 
variety of anomalous properties. For example, it is possible to define a simultaneous 
choice problem in which pro{a) is the fact <p = "the first round in which p receives an 
external request is a round whose number is the index of a halting Turing machine'' (in 
some a priori well-defined enumeration of Turing machines), and con(a) is -up. Clearly, 
since it is undecidable whether <p holds even given the view of p after it receives its first 
request, it will also be undecidable which of C M <p or C M -«p holds when processor p's view 
becomes common knowledge. It follows that this simultaneous choice problem cannot 
be effectively implemented by a computable protocol. Similarly, one can construct 
simultaneous choice problems in which evaluating the conditions is intractable, rather 
than undecidable as in the above example. It is also possible to introduce anomalies by 
defining the sets I\ of external inputs in strange ways. Since we are not interested in 
problems involving such inherent anomalies, we will avoid them by making restrictions 
on the relevant facts and the inputs arising in the simultaneous choice problems we will 
consider in the sequel. 

We first define the class of practical facts, which will be used to restrict the conditions 
that specify a simultaneous choice problem. Roughly speaking, one essential property 
of a practical fact <p is that it is easy to determine from a processor's view whether a 
run satisfies <p. More formally, we denote by u Qs{p, f) n the property of being a run p' 
such that Qs{p,t) = Qs{p',L)- Consequently, if §s(p,&) ^> <P is valid in a system, 
then every run p' of the system satisfying Qs{p,t) = Qs(p',t) must also satisfy ip. In 
this case, we say that Qs{p,t) determines <p. Notice, for example, that no finite labeled 
communication graph Qs{Pi £) can determine that a run is failure-free. With this notion 
in mind, a fact <p is said to be practical within a class of systems {E(n, i) : n > t + 2} 
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if the following conditions hold: (i) ip is a fact about the input and the existence of 
failures, and (ii) there is a polynomial-time algorithm to determine, given n, t, and 
a graph Qs{p,L) at a point of E(n,<), whether Qs{p,l) D ^ is valid in £(n,i). The 
first condition is justified by the fact that we will be testing for common knowledge 
of the conditions enabled(ai) arising from natural simultaneous choice problems, since 
such conditions are typically conditions on the input and existence of failures. The 
second condition ensures that it is easy to test whether a labeled communication graph 
determines that the fact holds. 

We now consider a natural restriction on the sets I\- of possible inputs. A class 
of systems is said to be practical if there are two fixed finite sets S and M of initial 
states and external requests, respectively, such that each I\ in all systems of the class 
is the set of complete input histories whose initial state is in S, and in which the input 
received in every round is a subset of M. This condition ensures that the input sets 
are of a simple form. In particular, it implies that all T.'s are identical, and that the 
input received by a processor during any given round is of constant size. 

Having defined the notions of practical facts and practical classes of systems, we say 
that a simultaneous choice C is practical if (i) the class of systems determined by a full- 
information protocol and C is practical, and (ii) each condition enabled{ai) is practical 
within this class of systems. Essentially all natural simultaneous choice problems are 
practical. In particular, all simultaneous choice problems in the literature are practical. 
Our analysis will hence be restricted to testing for common knowledge of practical facts 
and to designing and implementing optimal protocols for practical simultaneous choice 
problems. We remark, however, that our analysis will apply to a more general class of 
simultaneous choice problems, whose precise characterization is somewhat complicated. 

In Section 5 we programmed protocols for simultaneous choice problems in a high- 
level language in which processors' actions depend on explicit tests for common knowl- 
edge. Recall that test-for-C M enabled^) is a test nonfaulty processors can use to de- 
termine whether enabled(ai) is common knowledge: Given the graph corresponding 
to the view of a nonfaulty processor at (p,£), test-for-C M enabled(ai) return true iff 
(p,£) f= C M enabled(ai). Theorem 7 implies that given such a test for each condition 
enabled(ai), the protocol J c is an optimal protocol for C. Until this point, however, we 
have sidestepped the issue of whether such tests actually exist. With the next lemma 
we see that, for practical simultaneous choice problems, such tests can be implemented 
in polynomial space. 

Lemma 9: If C is a practical simultaneous choice problem, then for each action a,- 
the test test-for-C M enabled(ai) can be implemented in polynomial space. 

Proof: We must exhibit an algorithm test-for-C M enabled(ai) determining in poly- 
nomial space whether enabled(ai) is common knowledge at (p,i), given n, t, and the 
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graph Sj{p,t) corresponding to the view of a nonfaulty processor py at (/?,£). We will 
actually exhibit a nondeterministic algorithm A,- determining whether enabled^) is 
not common knowledge at (p,i). Since NPSPACE=PSPACE and PSPACE is closed 
under complementation (cf. [HU]), the existence of the algorithm A,- implies the ex- 
istence of an algorithm test-for-C M enabled(a,i). Let {L(n,t) : n > t + 2} be a class of 
systems determined by a full-information protocol and the problem C. We claim that 
such an algorithm A, need only guess a point (t],£), and show both that (/>,£) ~ (r?,£) 
and that £(r?,£) D enabled^) is not valid in T,(n,t). Since £(r7,£) Z> enabled^) is 
not valid in the system, there must be a point (r?',£) such that Q[n,L) = Q{n',L) and 
W \fy V= e,nabled{ai) ■ Let f be a run with the input of either n or n' in which the only 
processors failing are those recorded as failing in §(n,i) — Q(r)',l). Any nonfaulty 
processor in n or 77' must also be nonfaulty in f , and also have the same view at time £ 
in both runs. Consequently, (77, £) ~ (f,£) and (f,£) ~ {n',t). Therefore, (p,£) ~ (n',l) 
and (77', £) ^ enabled^), so (p,t) ^ C M enabled(a,i). 

We now describe the algorithm Ai in greater detail. Notice that since C is practical, 
the input received by a processor at each round during a run of £(n, t) is of constant size, 
and hence it is possible to construct the labeled communication graph of any point of 
E(n, t) in polynomial space. The algorithm Ai begins by constructing the graph Q(p' ', £) 
of a run p' by adding to the graph Qj{p,t) received as input all edges not recorded as 
missing in Q 2 \p, I). Notice that since pj is nonfaulty in p, it is nonfaulty in p' as well, and 
hence that (/>,£) ~ (p',£). The algorithm A, then shows that (/>',£) ~ (77, £) (and hence 
that (p,i) ~ (t7,£)) in polynomial space by constructing one by one the graph ,£(&,£) 
of each point (f,,£) in a path from (/»',£) to (n, I) in the similarity graph. For each pair 
of points (&_!,£) and (f,,£), the algorithm shows that some nonfaulty processor p k has 
the same view at both points by choosing p k , exhibiting for each point an assignment of 
faulty processors (consistent with their respective graphs) in which p k is nonfaulty, and 
showing that p k has the same view at both points by verifying j?*(ft-i,£) = £*(&,£)• 
Finally, since enabled^) is a practical fact, A,- can show in polynomial time (and hence 
in polynomial space) that Q{n,t) D enabled(a.i) is not valid in the system E(n,t). □ 

We note that the proof of Lemma 9 actually shows that testing for common knowl- 
edge of any practical fact can be done in polynomial space. In fact, the proof shows 
that such tests have effective implementations even when the algorithm determining 
whether Q{p,t) D enabled^) is valid does not run in polynomial time (although the 
problem must still be decidable). In this case, however, the test is guaranteed to run in 
polynomial space only if this computation can be performed using polynomial space. 
The most important consequence of Lemma 9, however, is that practical simultaneous 
choice problems have polynomial-space optimal protocols. 

Theorem 10: If C is an implementable practical simultaneous choice problem, then 
there is a polynomial-space, optimal protocol for C. 
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With Theorem 10 we see that practical simultaneous choice problems do have ef- 
fective optimal protocols. In general, however, connected components in the similarity 
graph may be of exponential size, and paths in such components may be of exponential 
length. It therefore follows that the polynomial-space protocol given by Theorem 10 
requires the processors to perform exponential-time computations between consecutive 
rounds of communication. The resulting protocol is therefore clearly not a reasonable 
protocol to use in practice. A crucial question at this point is whether there are efficient 
optimal protocols for simultaneous choice problems. Recall that we have already seen 
that optimal protocols can be implemented in a way that makes efficient use of commu- 
nication. The rest of the paper is devoted to investigating ways of implementing tests for 
common knowledge in variants of the omissions model in a computationally-efficient 
manner, and therefore of implementing efficient, optimal protocols for simultaneous 
choice problems in these models. 

6.1 The Omissions Model 

In this section we consider the problem of efficiently implementing tests for common 
knowledge in the omissions failure model. Recall from Theorem 2 that the connected 
component of a point in the similarity graph completely determines what facts are 
common knowledge at that point. We develop an efficient construction that crisply 
characterizes the connected component of a point in the similarity graph. With this 
construction we devise efficient tests for common knowledge, and hence efficient proto- 
cols for simultaneous choice problems that are optimal in all runs. 

The construction itself is motivated by a careful analysis of what facts do not be- 
come common knowledge during runs of a full-information protocol. (Unless otherwise 
mentioned, all protocols referred to in this section will be full-information protocols.) 
We begin with a technical result, similar to Lemma 15 of [DM]. In this and following 
results, it will be necessary to refer to runs whose operating environments differ slightly 
from each other. Therefore, given two runs of a protocol J, we will say that a run p 
differs from a run p' only in a certain aspect of the operating environment, if p is the 
result of executing 7 in an operating environment that differs from that of p' only in 
the said aspect. Notice that the messages sent in p may actually be quite different 
from those sent in p'. We say that a processor is silent from time k if it fails to send 
all messages in rounds following time k. 

Lemma 11: Let p and p' be runs differing only in the (faulty) behavior displayed by 
processor p after time k, and suppose no more than / processors fail in either p or p'. 
Ifl-k<t + l-f, then (/>,£) ~ {p',£.). 

Proof: If k > I then Q{p,l) = Q{p',t), and Lemma 8 implies that (p,i) ~ {p',£). 
Therefore, assume k < L We proceed by induction on j = t - k. 
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Suppose j = l (that is, k = £ - 1). Without loss of generality, we may assume 
that p and p' actually differ in the faulty behavior of p, and hence that p fails in one of 
these runs. Notice that since p already fails in one of these runs and yet no more that t 
processors fail in either run, it is clear that at most t processors fail in a run differing 
from either run only in the faulty behavior of p. Now, since t < n — 2 and since p 
and p' differ only in the behavior of p, there are two processors q and r (other than p) 
that do not fail in either run. Let p r be the run differing from p only in that p sends 
to r during round £ of p r iff it does so in p' . Since g's view at time £ is independent 
of whether p sends to r during round £, we have (p,£) ~ (p r ,£). Let p' r be the run 
differing from p r in that p sends to precisely the same processors during round £ in p' r 
and p 1 . Since r's view at time £ is independent of whether p sends to the remaining 
processors during round £, we have (p r ,£) ~ (p,,£). Since Q{p' r ,L) = £(p',£), it follows 
that {p' r ,l) ~ (p',£). Thus, by the transitivity of "-," we have (p,£) ~ (p',£). 

Suppose j > 1 (that is, k < £.— 1) and the inductive hypothesis holds for j — 1. Let p.- 
be the run differing from p only in that for each processor q in {p 15 . . . , p,} processor p 
sends to 9 during round k + 1 in p,- iff it does so in p' . Notice that p — p and p' = p n . 
We will show that (p,£) ~ (p,-,£) for all t > 0. Since p n differs from p' only in the 
faulty behavior of p after time k + 1, and since £ - (k + 1) = j - 1, it will follow by the 
inductive hypothesis for j -1 that (p n ,£) ~ (p',£). Finally, by the transitivity of "~," 
we will have (/?,£) ~ (p',£) as desired. 

We now proceed by induction on t to show that (p,£) ~ (p,-,£) for all i > 0. The 
case of t = is trivial. Suppose t > and the inductive hypothesis holds for i - 1; that 
is, (p,£) ~ (p,_i,£). Notice p t _i and pi differ at most in whether p sends a message 
to pi during round k + 1. Let 77 be the run differing from p,_i in that Pi is silent from 
time k+ 1 in rj. Suppose no more than g processors fail in either p,_i or rj. Notice that 
9 < f + 1. Therefore, since l<l-k<t + l-fwe have / < t and g < t, so at most t 
processors fail in r\. Furthermore, £-(A: + l) < t + 1 - (/ + 1) < t + 1 - g. Since, 
in addition, p t _x and rj differ only in the faulty behavior of p,- after time k + 1, the 
inductive hypothesis for j — 1 implies (p t _ x ,£) ~ (??,£). Now, since p,- is silent from time 
A; + 1 in 77, the view of a nonfaulty processor at (rj,t) is independent of whether p sends 
to pi during round k + 1, so (77, £) ~ (77', £) where 77' differs from 77 in that p sends to p,- 
during round A; + 1 in 77' iff it does so in p^. Again, the inductive hypothesis for j — 1 
implies that (77', £) ~ (p,-,£). By the transitivity of "~," it follows that (p,£) ~ (p,-,£). 

□ 

While Lemma 11 is a technical lemma in the context of this work, it has a number of 
interesting consequences in its own right. In particular, the (t +l)-round lower bound on 
the number of rounds required for simultaneous Byzantine agreement is an immediate 
corollary of this lemma. The resulting proof of this lower bound is perhaps the simplest 
to appear in the literature (see [DM] for details). More importantly, however, with 
Lemma 11 we can prove two corollaries that will enable us to characterize the connected 
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Figure 2: Runs illustrating Lemma 12. 



components of the similarity graph. Consider the runs p x and p 2 of Figure 2, where 
we indicate only faulty behavior: solid lines indicate silence, and dashed lines indicate 
sporadic faulty behavior. Notice that / processors fail in p x . In the following lemma 
we show that (pi,£) ~ (p 2 ,i) where p 2 differs from p x only in that processors failing 
in p x are silent in p 2 from time A;, where k = t-(t + l-f). This implies, for instance, 
that the views at time k of processors failing in p x are not common knowledge at time £ 
since these processors are silent from time jfc in p 2 . 

Lemma 12: Let px be a run in which / processors fail. Let p 2 be the run differ- 
ing from px only in that processors failing in px are silent from time k in p 2 , where 
k = l-{t + l-f). Then (/>!,£) ~ (p 2 ,£). 

Proof: Let qi,...,q t be the faulty processors in p t . Let 77,- be the run differing 
from px in that processors q lt . . . ,q { are silent from time A; in 77,-. Notice that px = r) 
and p 2 = ri„. We proceed by induction on t to show that (/>i,£) ~ (r?,-,£) for all i. The 
case of t = is trivial. Suppose t > and the inductive hypothesis holds for i - 1; that 
i s ) (Pi>^) ~ (»7,-_i,£). Since r?,_! and 77,- differ at most in the faulty behavior of q { after 
time k, it follows by Lemma 11 that (r?,-i,£) ~ (r7,-,£). By the transitivity of "~," we 
have (/>!,£) ~ (r? t -,£). D 

Before discussing the second lemma, we make an important definition. Given a 
point (p, k) and a set of processors G, let 

B{G,p,k) d 4 f {p : (p,k) \= I a { a p is faulty")} . 

By this definition, B(G,p,k) is the set of processors implicitly known by G at (p,k) 
to be faulty. An important property of the omissions failure model is that processors 
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fail only by failing to send messages. It follows that G implicitly knows at {p,k) that a 
processor p is faulty iff G implicitly knows at (p, k) of some processor q not receiving a 
message from p before time k; that is, g G (p, k) contains no edge from {p,t- 1) to (q,t) 
for some node (q,t) of Q G {p,k). It is therefore simple and straightforward to compute 
B{G,p,k) given Q G {p,k). 

The essence of the second lemma is captured by the runs p 2 and p% of Figure 3. In 
the run p 2 , the / faulty processors are silent from time k = I— (t + 1- f). The set 
G is the set of nonfaulty processors and B — B(G,p 2 ,k). The run p s differs from p 2 
only in that processors in P - B do not fail in p s . The following lemma states that 
{P2,£) ~ {Ps,t)- This implies, for instance, that the failure of processors in P — B can 
not be common knowledge at (p 2 ,£) since they do not fail in p 3 . Formally, we have (see 
Figure 3): 

Lemma 13: Let p 2 be a run in which the / faulty processors are silent from time 
k = t— (t+1 — /). Let G be the set of nonfaulty processors in p 2 > and let B — B(G,p 2 ,k). 
Let p 3 be the run differing from p 2 only in that processors in P - B do not fail. Then 

(/>2,£)~(P3,£). 

Proof: If a processor p in P — B fails to a processor q during some round j < k 
of p 2 , then the node (q,j) must not be a node of Qa{P2,k) or the failure of p would be 
implicitly known by G at time k and p would be in B, a contradiction. Thus, Q G {Pi, k) 
is independent of whether Q{p 2 , k) contains an edge from p to q during round j. Let p\ 
be a run differing from p 2 only in that no processor in P — B fails before time k in p 2 . 
By the previous discussion, ^g(p2,^) = §a{p' 2 ,k). In both p 2 and p 2 every processor 
in G successfully sends every message after time k and every processor in B — P — G 
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Figure 4: An example of the construction when t = 9. 



is silent from time k. Since, in addition, every processor in G receives the same input 
after time k in p 2 and p' 2 , we have $ G {P2,£) = Qg{p' 2 ,L). Given that G is the set of 
nonfaulty processors in p 2 , each of which is also nonfaulty in p' 2 , it follows by Lemma 8 
that (p 2 ,l) ~ (p' 2 ,£). Since the runs p 2 and p 3 differ only in the faulty behavior of 
processors in P - B after time k, by repeated application of Lemma 11 it follows that 
{&,*>) ~ (ps,£). Hence, (p 2 ,£) ~ (p 3 ,£). □ 

Having seen Lemmas 12 and 13, let us consider how these results suggest a charac- 
terization of the similarity graph, and hence of what facts are common knowledge at 
a given point. Going back to Figures 2 and 3, notice that if /' < / (where /' is the 
number of processors in B), then by setting p\ = p 3 we can apply Lemmas 12 and 13 
again. Iterating this process, we reach a run p satisfying (pi,£) ~ (p,£) where the / 
processors failing in p are silent from time k = I — (t + 1 — f), and where all faulty 
processors are implicitly known to be faulty by the nonfaulty processors at (p, k). No- 
tice that the run p is a fixpoint of this iterative process (that is, applying Lemmas 12 
and 13 to p yields \p itself). We claim, in addition, that the joint view of the nonfaulty 
processors at (p,k) characterizes the connected component of (pi,£) in the similarity 
graph, and hence what facts are common knowledge at (pi,£). In order to make this 
claim precise, we now formalize a local version of this iterative process, illustrated in 
Figure 4, that processors can use to construct locally this joint view. 

Let p be an arbitrary processor. We define G — {p} and A; = £, and we define 
G,+i and k i+i inductively. Denoting B(Gi,p,ki) by £,-, let 

Gj+i — P — Bi 

ki+i=t-{t + l-\Bi\). 
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Notice that when fcj+i < 0, the view at time A;,+i of every processor in G, +1 is the 
distinguished empty view, and hence B i+1 must be empty. As a consequence, for all 
j > i + 1, we have that G,- = P, kj = £ - (t + 1), and B, is empty. This construction 
determines three (infinite) sequences {G,}, {A:,}, and {!?,■}. In the next few pages we will 
see that these sequences have limits G, k, and B, and that these limits are independent 
of the processor with which the construct is begun. As a result, individual processors 
will be able to construct these values based solely on their local view. We will see 
that the joint view of G at time k completely characterizes the connected component 
of (p,£) in the similarity graph, and hence what facts are common knowledge at (p,i). 
This construction will therefore provide an efficient way of determining what facts are 
common knowledge at a given point. 

Among other things, this construction captures a number of essential aspects of the 
information flow during the run up to time £. In particular, one important property of 
this construction is the following: 

Lemma 14: Every processor in G,+i successfully sends to every processor in G,- in 
every round before time A;,-. 

Proof: Suppose some processor q of G,+i fails to send to a processor q' of G, during 
a round before time A;,-. Then g's failure to q' is implicitly known by G< at time A:,-, so 
q € Bi and q £ G, + i, a contradiction. □ 

One consequence of Lemma 14 is that the view of the processor p at time t must 
contain the view of every processor in G, at time A:,- for every i > 0. Thus, an essential 
property of the construction is that it depends only on the view of processor p at (/>,£), 
and hence that p is able to compute these sets locally. A second essential property of 
the construction is that it converges within t + 1 iterations, as we see with the following 
result. 

Lemma 15: lim G, = G t+1 and lim A;,- = k t+1 . 

I-+00 «'— »oo 

Proof: We will show that B i+1 C B t for all i > 0. Since B contains at most t 
processors, it will then follow that there must be an i < t for which £,- = B i+l . From 
the definition of the construction, it is easy to see that we will have Bi — Bi+j for all 
j > 0. In addition, we will have G i+1 = G,+i +J - and A;, +1 = A;,-+i +J - for all j > 0, and 
we will be done. We proceed by induction on i. If A;, + i < 0, then U,+i is empty and 
Bi+i C B{, so let us assume fc, + i > 0. Suppose t = 0. By Lemma 14, every processor 
in G\ must send to every processor in G during round kx + 1. It follows that any 
failure implicitly known by G\ at time A;i must be implicitly known by G at time A; . 
Thus, J5i C B . Suppose i > and the inductive hypothesis holds for i — 1; that is, 
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Bi C Bi-x. If Bi = Bi- U then B i+1 = B { . If B { C B,_!, then k i+1 < k { . By Lemma 14, 
G i+1 sends to G, during round A; t+1 + 1, so B, +1 C Bi. □ 

We denote the results of the construction (the limits of the sequences {G,}, {A:,}, 
and {Bi}) by G, k, and B. We denote these values by G(p,p,l), k(p,p,E), and B(p,p,L) 
when the processor p and the point {p,l) are not clear from context. We now show, 
however, that these values are independent of processor p. 

Lemma 16: For all processors p and q, G(p, p, £) = G(q, p, £) and k(p, p, £) = k(q, p, £) . 

Proof: We prove the claim by showing that B(p,p,E) = B(q,p,£). Given that 
Bi uniquely determines G i+1 and k i+i , this will imply the desired result. It suffices 
to show that B(p,p,l) C B(q,p,l), since the other direction will follow by symmetry. 
Denote the intermediate results of the construction from the point (p, £) starting with 
the processor p by G,-, k t , and £,, and the final results by G, k, and B. Similarly, 
denote the intermediate results of the construction starting with q by G[, k' t , and B' { , 
and the final results by^ G', k', and B'. We now show that B C B'. If jt < 0, then 
B is empty and B C B', so assume k > 0. We consider two cases. First, suppose 
k = I — 1. In this case, £? must contain t faulty processors since k = £— (t + l — \B\). It 
follows that every processor in G must be nonfaulty and hence must send to G' during 
round k + 1, so B C B' . Since, in addition, \B' \ < t and |J9| = t, we have J3 = B' . 
It follows from the construction that B = B t - for every t > 0, and hence that B — B'. 
Now, suppose k < £ — 1. Let r be an (arbitrary) nonfaulty processor in p. We claim 
that every processor g in G must send its view to r during round k + 1. Suppose some 
processor g in G does not. Let j be the least integer such that G = G,. If j = 1, 
then r must send to G during round k + 2. If j > 1, then r must actually be a member 
of Gj_i since G^-i must contain all of the nonfaulty processors. In either case, the 
failure of g to r during round k + 1 must be implicitly known by Gj- X at time kj- lf 
so g £ Bj-i. Since G = Gj = P - Bj-i, we have g £ G, a. contradiction. Thus, every 
processor in G must send to r during round k + 1. We now proceed by induction on * 
to show that B C B[ for all t > 0. Suppose t — 0. Every processor in G must send 
to the nonfaulty processor r during round k + 1, and r must send to G' Q during round 
fc + 2,soBC B' . Suppose t > and the inductive hypothesis holds for i — 1; that is, 
B C £?_!• If B = B!_!, then S = SJ. If B c B\_ x , then fc < k\. Every processor in G 
must send to the nonfaulty processor r during round k + 1, and r must be contained 
in G\, so B C 5J. It follows that B C S,? for all « > 0, and hence B CB'. D 

As a result of Lemma 16, we see that G, k, and B depend only on the point (p, £), 
and not the processor with which the construction begins. Thus, a third essential 
property of this construction is that every processor (and not just, say, the nonfaulty 
processors) is able to compute locally the values of G, k, and B. We will denote these 
values by G(p,£), £(p,£), and B{p,l) when (p,£) is not clear from context. From the 
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definition of the construction it is clear that the driving force behind the construction 
is the identity of the sets £,. Notice that these sets are uniquely determined by the 
failure pattern, and do not depend on the run's (external) input. Taking into account 
the external input of a run, we are now in a position to show how the construction 
characterizes the connected components in the similarity graph. Denoting G(p,£) by G 
and k(p,£) by k, we define 

V(p,£) d ^v(G,p,k). 

This definition says that V(p,£) is the joint view of the processors in G(p,£) at time 
k[p,£). Our next lemma implies that V is the same at similar points, which implies 
that the joint view V[p,£) is common knowledge at (p,£). 

Lemma 17: If (p,£) ~ (p',£) then V{p,£) = V{p',£). 

Proof: We proceed by induction on the distance d between the points (p,£) and 
(p',£). The case of d — is trivial. Suppose that d > and the inductive hypothesis 
holds for d - 1. Since the distance between (p\£) and (p,£) is d, there must be a 
point (77, £) whose distance from (p,£) is d - 1, and whose distance from (p',£) is 1. 
The inductive hypothesis implies that V{p,£) = V(rj,£), and we must have v(p,r},£) = 
v(p,p',£) for some processor p. As a consequence of Lemmas 14 and 16, the values 
of V (77, £) and V(p',£) depend only on the view of p at (77, £) and (p',£), respectively. 
Since p has the same view at (77, £) and at (p',£), we have V(r), £) = V(p',£). Since 
V(p,£) = V(ri,£), it follows that V{p,£) = V{p',£). □ 

Conversely, we wish to show that all points with the same V are similar, and hence 
that V completely characterizes the connected components of the similarity graph. 
Before we do so, however, we formalize the reasoning with which Lemmas 12 and 13 
motivated consideration of the construction in the first place. 

Lemma 18: Let p be a run, and let G, k, and B be the results of the construction 
from (p,£). Let p' be the run differing from p only in that processors in G do not fail 
in p' and processors in B are silent from time k in p'. Then (p,£) ~ (p',£). 

Proof: Let G,-, A;,-, and f?,- be the intermediate results of the construction from (p,£) 
starting with the nonfaulty processor p,. For i > 0, define p,- to be the run differing 
from the run p only in that processors in B t are silent from time fc, in p,- and the 
remaining processors do not fail in p,-. Notice that p = p and p' = p,- for sufficiently 
large i. We proceed by induction on * to show that (p, £) ~ (p,-, £) for all » > 0. Suppose 
i = 0. Since the subgraph §j(p,£) must be independent of whether the graph 5(p,£) 
is missing an edge from a processor in P - B to a processor other than py, we have 
9i{Pi£) = 9j{Po,ko). Since processor p 3 - is nonfaulty, it follows that (p,£) ~ (po,£). 
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Suppose i > and the inductive hypothesis holds for t — 1; that is, (/>,£) ~ (/),_ x ,£). 
Lemma 12 implies (p,-_i,£) ~ (pJ-_!,£) where pj^ differs from p,_i in that processors in 
J9,-_i (the processors failing in p.-x) are silent from time &,- in p(_ x . Lemma 13 implies 
(4-1.*) ~ (*.*)• Thus, (p,£) ~ (p,,£). Q 

Finally, we have the following: 

Lemma 19: If V{p,l) = V(p',i) then (p,£) ~ (p',£). 

Proof: The fact V{p,t) = V{p',£) implies G(p,£) = G(p',£), k{p,fi = Jfc(p',£), and 
B{p,f) = B(p',£). We therefore denote these values by G, k, and B. Let f be a run 
that differs from p in that processors in G do not fail in f, and processors in B are silent 
from time k in f. Let <;' be an analogous run with respect to p'. Lemma 18 implies 
that (p,£) ~ (f,£) and (p',£) ~ (f',£). In order to show that (p,£) ~ (p',£), it is enough 
to show that (f,£) ~ (f',£). Suppose G = {q 1 ,...,q s }, and let ft be the run differing 
from f in that q 1 ,...,q i receive the same input after time k in ft as they do in f\ We 
proceed by induction on * to show that (f,£) ~ (ft,£) for all i > 0. Since p = p , the 
case of t = is trivial. Suppose i > and the inductive hypothesis holds for t — 1; that 
i s ) (f>^) ~ (&-i>£)- Let r7,_! and r/j be runs differing from ft_i and ft, respectively, only 
in that q t is silent from time k in r7 t -_i and r/,-. Lemma 11 implies (ft_i,£) ~ (r/,-_i,£) 
and (ft,£) ~ (j7,-,£). In addition, since ?/,•_! and ??,• differ only in the input received by q t 
after time k, and since q t is silent from time k in both runs, we have (77,-1, £) ~ (r7,-,£). 
Thus, (f,£) ~ (ft,£) for all i > 0. In particular, (f,£) ~ (ft,£). In order to complete 
the proof, it now suffices to show that (ft,£) ~ (f',£). Since Q 6 {p,k) = Q d (p',k), 
{p,t) ~ (f,*) and (p',£] ~ (f',£), Lemma 17 implies that ^(f.jfe) = ^(f'.ik). Notice 
that £<;(&,&) = £<5(f,£) = ^(f'jfc). Notice, in addition, that processors in G do not 
fail in either ft, or f', and that the remaining processors (in B) are silent from time k 
in both runs. Finally, notice that processors in G receive the same input after time k 
in both runs. It follows that Q 6 {s„t) = £<?(f',£), and hence that (&>^) ~ ($V)- Thus, 
(fiO ~ (f*.0. ^ desired. D 

Combining Lemmas 17 and 19 we see that (p,£) ~ (p',£) iff V{p,l) = V{p',l). We 
therefore have: 

Theorem 20: (p,£) (= C*^ iff (p',£) (= <p for all p' satisfying V{p,t) = t>(p',£). 

It follows that the identity of V in a precise sense summarizes and uniquely deter- 
mines the set of facts that are common knowledge at any given point. The identity of 
V can be thought of as being composed of two components: The identity of G and k, 
and the information about the input that is contained in the joint view V. The def- 
mition of the construction implies that the identities of G and k depend only on the 
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failure pattern, and hence carry only information about the failure pattern. The fact 
that V becomes common knowledge implies that certain information about the failure 
pattern must become common knowledge. It is difficult, however, to characterize the 
facts about the failure pattern that follow from the identity of G and k in terms of 
the communication graph Q (p,£j. On the other hand, information about the input 
that follows from the views in V does characterize in a crisp way what facts about 
the input are common knowledge. Furthermore, it is easy to deduce from V whether 
the existence of a failure is common knowledge. As the following corollary will show, 
Theorem 20 implies that facts about the input and existence of failures that are com- 
mon knowledge at the point {p,t) must follow directly from the set V(p,l). We now 
make this statement precise. A run p, a set of processors G, and a time k determine 
a joint view V = v(G,p,k). We denote by u V n the property of being a run in which 
the processors in G have the joint view V at time k (notice that G and A; are uniquely 
determined by V). Thus, if V D ip is valid in the system, then every run p' satisfying 
v(G,p',k) = V must also satisfy <p. We now have: 

Corollary 21: Let <p be a fact about the input and the existence of failures, and let 
V = V(p,l). Then {p,l) f= C M <p iff V D <p is valid in the system. 

Proof: ^ Let V = V(p,£). Suppose V D <p is valid in the system. By Lemma 17, 
we have V(p,£) = V(p',t) for all runs p' such that (p,£) ~ (/>',£), and hence that 
{p',t) \= V for all such p'. Given that V D <p is valid in the system, we have (//,£) (= <p 
for all such p'. It follows that (p,£) \= C M <p. 

Conversely, suppose that V D ip is not valid in the system. Since V D <p is not valid 
in the system, let r\ be a run such that (»?,£) \=V and yet [rj, I) ^ <p. We will construct 
a run f such that (p,£) ~ (f,£), f and r\ have the same input, and f and r\ are the same 
with respect to the existence of failures. Since (p is a fact about the input and the 
existence of failures, (rj,£) ty= <P will imply (f,£) ¥= <p. Since, in addition, (p,£) ~ (f,£), 
we will have that (/?,£) ^= C M <p. 

We construct f in two steps. We first construct a run £ with the input of 77 satisfying 
(p,£) ~ (£, £). Let £ be the run with the failure pattern of p and the input of r\. Given 
that p and £ have the same failure pattern, and that G and k depend only on the 
failure pattern, we have that G{p,t) = G(£,£) and k(p,l) — £(£,£). Let us denote 
these values by G and k. Since (77, £) |= V, we have v(G,p,k) = v(G,i],k), and hence 
9d{P^) — GdiWik). Since £ and p have the same failure pattern, the unlabeled graphs 
underlying $<*{£,&) and Q$(p,k) (and hence also §a{r},k)) are the same. Furthermore, 
since £ and 77 have the same input, it follows that $<${£,&) and Qa{ri,k) (and hence 
also £3 (/£>,&)) are equal. Since 9^{p,k) = $<*{£, k) implies V{p,L) - V (f,£), we have 
{p,t) ~ {£.,£) by Lemma 19. 
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We now consider the existence of failures, and construct the desired run £ . If there 
is a failure in 77, then let f be a run differing from £ only in that a processor fails 
after time £ in f. Clearly (£,£) ~ (f,£), and hence (p,£) ~ (f,£). Conversely, if 77 is 
failure-free, then let f — 77. Since 77 is failure-free, no processor in G knows of a failure 
at time k in 77. Since processors in G have the same view at time k in both 77 and p, 
the same is true of p. It follows that B = B(G,p,Jfc) is empty, and since G — P - B, 
we have that G = P. Notice that f differs from £ only in that processors in G = P do 
not fail in f, and hence that (£,£) ~ (f,£) by Lemma 18. Therefore, (/>,£) ~ (f,£). In 
either case, (p,£) ~ (f,£), $ and 77 have the same input, and are the same with respect 
to the existence of failures. It follows by the above discussion that (/>,£) ^ Cy,f>. □ 

Corollary 21 summarizes the sense in which the construction allows us to test 
whether relevant facts are common knowledge at a given point. Let us consider the 
computational complexity of performing such tests. The first step in applying Corol- 
lary 21 to determine whether a fact is common knowledge at (p, I) is to construct 
V(p,l). Recall that a group of processors implicitly knows that a processor is faulty 
iff it knows of a message the processor failed to send. This is an easy fact to check 
given the communication graph corresponding to the group's view. It follows that 
computing every iteration of the construction can easily be done in polynomial time. 
Furthermore, since the construction is guaranteed to converge within t + 1 iterations, it 
follows that G and k, and hence also V can be computed locally in polynomial time (as 
long as V is of polynomial size). Recall that if <p is a practical fact, then it is possible to 
determine in polynomial time whether or not V Z> <p is valid in the system. Thus, given 
a practical simultaneous choice problem C, one polynomial-time implementation of a 
test for common knowledge of enabled^) is to construct the set V = V and determine 
whether V D enabled^) is valid in the system. As a result, Theorem 7 implies the 
following: 

Theorem 22: If C is an implementable, practical simultaneous choice, then there is 
a polynomial-time optimal protocol for C. 

We reiterate the fact that the resulting protocol for C is optimal in all runs: for 
any given operating environment, actions are performed in runs of 7 C as soon as they 
could possibly be performed by any other protocol. Thus, for example, simultaneous 
Byzantine agreement is performed in anywhere between 2 and t + 1 rounds, depending 
on the pattern of failures (as is shown in [DM] to be the case in the crash failure 
model). Similarly, the firing squad problem can be performed in anywhere between 1 
and t + 1 rounds after a "start" signal is received. Paradoxically, in all these cases, the 
simultaneous actions can be performed quickly only when many failures become known 
to the nonfaulty processors. In particular, if there are no failures, no fact about the 
input is common knowledge less than t + 1 rounds after it is first determined to hold. 
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Notice that every processor, faulty or nonfaulty, is able to compute the set V"(p,£) 
locally. As a result, the following proposition shows that a fact is common knowledge 
to the nonfaulty processors iff it is common knowledge to all processors. 

Proposition 23: Let <p be an arbitrary fact. In the omissions model, C M <p = C P <p is 
valid in all systems running a full-information protocol. 

Proof: By Theorem 2, it is enough to show that (p,i) ~ {p',t) iff (p,t) ~ (p',1) for 
all runs p and p' and times L The 'if direction is trivial, since M C P. The proof of 
the other direction is identical to the proof of Lemma 17, interpreting ~ as ~. □ 

Proposition 23 implies that all processors (even the faulty processors) know exactly 
what actions are commonly known to be enabled in runs of 7 C . Thus, in this model the 
protocol 7 C is guaranteed to satisfy a stronger version of simultaneous choice problems, 
in which condition (ii) is replaced by 

(ii') if a, is performed by any processor (faulty or nonfaulty) , then it is performed by 
all processors simultaneously. 

Furthermore, since when an action is performed it is performed simultaneously by all 
processors, and since no other action is ever performed, there is no need for processors 
to continue sending messages after performing actions in runs of T c in this model. We 
can therefore further optimize the communication of I c by having processors halt after 
performing a simultaneous action. As a result, the following is an optimal protocol for 
any implementable simultaneous choice problem C, an optimal protocol simpler than 
the protocol 7 C : 

repeat every round 

send current view to every processor 
until C M enabled(ai) holds for some a,-; 
j <— min{t : C M enabledfai) holds}; 
perform ay; 
halt. 

The fact that in the omissions model the information in V(p, I) is essentially all that 
is common knowledge at a given point has interesting implications about the type of 
simultaneous actions that can be performed in this model. For example, recall that in 
the traditional simultaneous Byzantine agreement or consensus problems (cf. [PSL], [F], 
[DM]), the processors are only required to decide, say, v in case they all start with an 
initial value of v. It would be more pleasing, however, if they could decide v whenever 
the majority of initial values are v. This is clearly impossible, since some processors may 
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be silent throughout the run. However, consider a protocol for simultaneous Byzantine 
agreement which is similar to 7 C , except that when some enabled(di) becomes common 
knowledge (which happens exactly when V becomes non-empty), the processors choose 
the value that appears in the majority of the initial values recorded in V(p,t) as their 
decision value. In this case, the processors actually approximate majority fairly well: 
If more than (n + 1)/2 of the initial values are v, then v will be chosen. In fact, we can 
show that the approximation is bad only in runs in which agreement is obtained early. 
In particular, if agreement cannot be obtained before time t + 1 (this would happen 
in runs p for which V (p,£) contains only empty views for every t < t), then the value 
agreed upon would be the majority value in case more than n/2 + 1 of the processors 
have the same initial value. Furthermore, a weak protocol for (exact) majority does 
exist: A protocol that either decides that there was a failure or decides on the true 
majority value. 

Since messages from faulty processors can convey new information about the failure 
pattern, such messages do affect the construction. Therefore, the behavior of faulty 
processors, even after they have been discovered to be faulty, plays an important role 
in determining what facts become common knowledge and when. In the crash failure 
model, however, a failed processor does not communicate with other processors after 
its failing round and has little impact on what facts become common knowledge. This 
is an essential property of the omissions model operationally distinguishing it from the 
crash failure model. 

We note, however, that all of the analysis in this subsection applies to the crash 
failure model, with all of the proofs applying verbatim when restricted to the crash 
failure model. We thus have: 

Proposition 24: In the crash failure model, (p,t) \= C M <p iff it is the case that 
(p',£) f= <p for all p' satisfying V[p,l) = V{p',l). 

Thus, the set V (p,£) completely characterizes what facts are common knowledge at 
the point (p, I) in the crash failure model as well. Since the same proofs show that the 
construction characterizes the connected components of the similarity graph in both 
the omissions and the crash failure model, the similarity graph in the omissions model is 
simply an extension of the similarity graph in the crash failure model, maintaining the 
same connected components. This implies that in a run of the omission model having 
a failure pattern consistent with the crash failure model, exactly the same facts about 
the input and the existence of failures are common knowledge at any given time in 
both the crash failure and the omissions model. (However, as a result of the difference 
in the types of failures possible in the two failure models, different facts about the 
failure pattern are common knowledge at the corresponding points.) Ruben Michel has 
independently characterized the similarity graph in variants of the crash failure model 
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(cf. [Mi]). For the crash failure model itself, he has an alternative construction that 
also characterizes the connected components of the similarity graph. 

As in the omissions model, it follows from Proposition 24 that our construction can 
be used to derive efficient optimal protocols for simultaneous choice problems in the 
crash failure model, thus slightly extending [DM] . We therefore have the following: 

Corollary 25: Let C be an implementable, practical simultaneous choice. In the 
crash failure model, there is a polynomial-time optimal protocol for C. 

As a final remark, let A:,- and G, be the intermediate results of beginning the con- 
struction at the point (p,t), and denote v{Gi,p, A;,-) by Vi. Consider the operator £ 
defined by £{V { ) = V i+1 for all i. We find it interesting that V, which is the greatest 
fixpoint of the operator £, characterizes the facts <p for which C M <p holds, where we 
know from [HM] that C M (p is the greatest fixpoint of X = <p A E M X. 

6.2 Receiving Omissions 

In the omissions model, faulty processors fail only to send messages. In this subsection, 
we consider the symmetric receiving omissions model, in which faulty processors fail 
only to receive messages. While at first glance these models seem very similar, they 
are actually extremely different. In particular, we will see that testing for common 
knowledge in this model becomes trivial. As a result, there are simple, efficient optimal 
protocols for practical simultaneous choice problems in this model. 

One intriguing difference between the omissions model and the receiving omissions 
model is the following. We have seen in the omissions model that in some cases a fact 
(for example, the arrival of a "start" signal) does not become common knowledge until 
as many as t + 1 rounds after it is first determined to hold. Intuitively, the attainment 
of common knowledge is delayed by the possibility that a processor might fail to send a 
message determining that the fact holds. However, in the receiving omission model even 
faulty processors send all message required by the protocol. Since nonfaulty processors 
receive all messages sent to them, in runs of a full-information protocol all nonfaulty 
processors have a complete view of the first k rounds at time k + 1. We can thus show 
the following: 

Theorem 26: Let cp be a fact about the first A: rounds. In the receiving omissions 
model, (p,k) f= <p iff (p, A; + 1) [= C M <p. 

The proof of this result depends on the notion of a fact being valid at time A;: a fact tp 
is said to be valid (in the system) at time k if for all runs p we have (p, k) f= <p. We 
remark that the following variant of the induction rule holds: 
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If ip Z> E s <p is valid at time k, 

then <p D C s <p is valid at time k. 

Proof: Since ip is a fact about the first k rounds, (p, k) f= ip iff (p, /: + 1) f= £>. Thus, 
it is enough to show that (p,k + l) \= <p iff (p, fc + 1) |= C*^. Clearly, (p, k + l) \=C M <p 
implies (p, k + l) \= (p. Conversely, suppose (p, k + l) (= <p. During round k + l in p 
every processor sends its entire view to all processors, so at time k + 1 all nonfaulty 
processors have a complete view of the first k rounds of p. Since <p is a fact about 
the first k rounds, (p,k + 1) \= E M cp. We have just shown that <p D E M <p is valid at 
time k + 1, so <p Z> C M <p is valid at time k + 1 as well. Thus, (p,k + 1) \= <p implies 
(p,fr + l) \=C„<p. □ 

As a consequence of Theorem 26, efficient optimal protocols for practical simulta- 
neous choice problems are very simple in this model. 

Corollary 27: Let C be an implementable, practical simultaneous choice. In the 
receiving omissions model, there is a polynomial-time optimal protocol for C. 

Proof: We claim that (p,£) \= C M enabled(a,i) iff Q{p,t - 1) D enabled^) is valid in 
the system. Since C is a practical simultaneous choice problem, determining whether 
5{p,t — l) Z> enabled(ai) is valid in the system can be done in polynomial time. Since 
all nonfaulty processors know §(p,L - 1) at (p,£), this will yield a polynomial-time 
implementation of a test for common knowledge of enabled^). Thus, Theorem 7 will 
imply that 7 C is a polynomial-time optimal protocol for C. Now, suppose §{p,l - 1) D 
enabled^) is valid in the system. Theorem 26 implies that Q(p,L — 1) is common 
knowledge at (p,£), and it follows that (p,l) \= C M enabled(a,i). Conversely, suppose 
(p,£) |= C M enabled(ai). Let f be a run satisfying Q{p,t - l). A proof similar to the 
base case of Lemma 11 shows that (p,l) ~ (f,£). Since (p,£) (= C M enabled(a,i), it 
follows that (f,£) |= enabled(ai). Thus, Q{p,L- 1) D enabled^) is valid in the system, 
as desired. □ 

The results of this section point out a number of interesting differences between 
the omissions model and the receiving omissions model. For example, consider the dis- 
tributed firing squad problem. First, Theorem 26 implies that all nonfaulty processors 
are able to fire in the receiving omission model exactly one round after the first "start" 
signal is received. Recall that in the omissions model, firing may delayed as many as 
t + 1 rounds. Second, since a faulty processor p might fail to receive all messages, it 
is not possible to guarantee that p will ever fire when a "start" signal is received by 
a nonfaulty processor. In the omissions model we have shown that it is possible to 
guarantee that all processors perform any action performed by the nonfaulty proces- 
sors. Finally, notice that faulty processors may sometimes be unable to halt, even after 
the nonfaulty processors have fired: A processor p receiving no messages or "start" 
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signals can never halt since at every point it is possible it will be the only processor 
in the system to receive a "start" signal. In this case, optimal protocols must require 
the nonfaulty processors to fire one round later, and hence p must be able to send 
this information to the nonfaulty processors. In contrast, in the omissions model it is 
possible to guarantee that all processors halt as soon as an action is performed in the 
system. These remarks show that while at first glance the assignment of responsibil- 
ity for undelivered messages to sending or to receiving processors may seem arbitrary, 
the assignment has a dramatic effect on when facts become common knowledge, and 
hence on the behavior of optimal protocols. Since such a simple modification of the 
omissions model results in the collapse of the combinatorial structure underlying the 
model (witness Theorem 26), we consider this to be an indication that the omissions 
model is not a robust model of failure. 



6.3 Generalized Omissions 

We have just seen that whether sending or receiving processors are responsible for 
undelivered messages has a dramatic effect on the structure of the omissions model. 
Perhaps a more natural model of failure is the generalized omissions model, in which 
a faulty processor may fail both to send and to receive messages. This section is con- 
cerned with the design of optimal protocols for simultaneous choice problems in this 
model. We have seen that Theorem 7 implies the protocol J c is an optimal proto- 
col in this model, and that Theorem 10 implies this protocol can be implemented in 
polynomial-space. As in previous sections, the remaining question is whether there 
are efficient optimal protocols in this model. The fundamental result of this section 
is that testing for common knowledge in the generalized omissions model in NP-hard. 
Using the close relationship between common knowledge and simultaneous actions, we 
obtain as a corollary that optimal protocols for most any simultaneous choice problem 
in this model require processors to perform NP-hard computations. Consequently, for 
example, in this model there can be no efficient optimal protocol for simultaneous Byz- 
antine agreement or the distributed firing squad problem. This is a dramatic difference 
between the generalized omissions model and the more benign failure models, where, 
as we have seen, efficient optimal protocols do exist. 

One important difference between the generalized omissions model and simpler vari- 
ants of the omissions model is that in the generalized omissions model undelivered 
messages do not necessarily identify the set of faulty processors, but merely place con- 
straints on their possible identities: Either the sender or the intended receiver of every 
undelivered message must be faulty. The faulty processors must therefore induce a 
"vertex cover" of the undelivered messages. Recall that in our analysis of the omis- 
sions failure model, determining the number and the identity of the faulty processors 
given the labeled communication graph of a point played a crucial role in characterizing 
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the facts that are common knowledge at a point. In that model, a processor is known 
to be faulty iff it is known that a message it was supposed to send was not delivered, 
a fact easily determined from the labeled communication graph. In the generalized 
omissions model, however, even determining the number (and not necessarily the iden- 
tities) of processors implicitly known to be faulty essentially involves computing the 
size of the minimal vertex cover of a graph, a problem known to be NP-complete (cf. 
[GJ]). It is with this intuition that we now proceed to show that determining whether 
certain facts are common knowledge is computationally prohibitive in the generalized 
omissions model, assuming P/NP. 

However, in order to study the complexity of testing for common knowledge in the 
generalized omissions model in a meaningful way, we are once again faced with the need 
to restrict our attention to a class of facts that includes all of the facts that may arise 
in natural simultaneous choice problems, and excludes anomalous cases. For example, 
if <p is valid in the system, then so is C M <p, and testing whether <p is common knowledge 
is a trivial task. On the other hand, one can imagine facts involving excessive com- 
putational complexity of a type irrelevant to simultaneous choice problems. Consider, 
for instance, a fact <p with the property that the communication graph of any point 
satisfying (p encodes information allowing the solution of all problems in NP of size 
smaller than the number of processors in the system. Whereas it seems unlikely that 
such a fact exists, this fact is probably very hard to prove, and it is definitely not the 
business of this paper to do. We are therefore led to make the following restriction. 
A fact tp is said to be admissible within a class of systems running a full- information 
protocol if (i) for all systems within this class neither <p nor -xp is valid in the system, 
and (ii) there is a polynomial-time algorithm explicitly constructing for each system 
a labeled communication graph Q{p,t) of minimal length having the property that 
Q(p,£) 2> <p is valid in the system. We say that a simultaneous choice problem C is 
admissible if each condition enabled^) is admissible within the class of systems deter- 
mined by a full-information protocol and C. We claim that any natural simultaneous 
choice is admissible. We can now state the fundamental result of this section which 
says, loosely speaking, that testing for common knowledge of admissible facts (p lt ...,(p t 
is NP-hard. 

Lemma 28: Let (p 1 ,...,(p s be admissible practical facts within a class of systems 
running a full-information protocol in the generalized omissions model. Given the graph 
5(p,t) of a point in such a system with n > 2t, the problem of determining whether 
(/>,£) |= V,- C M <pt is NP-hard. 

The proof of Lemma 28 will follow shortly. Notice, however, that t is variable in the 
statement of this lemma, and in general may be 0(n). The proof of this result will not 
apply for a fixed t, nor to cases in which t is restricted, say, to be 0(lg n). In any case, it 
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will follow that any standard implementation of our optimal knowledge-based protocols 
must be computationally intractable, unless P=NP. It is natural to ask whether this 
inefficiency is merely the result of having programmed our protocols using tests for 
common knowledge. It is conceivable, for instance, that there are optimal protocols 
for admissible simultaneous choice problems in the generalized omissions model that 
are computationally efficient. Intuitively, however, in order to perform a simultaneous 
action, an optimal protocol P must essentially determine whether any of the conditions 
enabltd{ai) is common knowledge. Corollary 6 implies that such a condition becomes 
common knowledge during the corresponding run of a full-information protocol as soon 
as it does during a run of P. Thus, P must essentially determine whether such a fact 
is common knowledge during the corresponding run of a full-information protocol 7. 
Since Lemma 28 implies that this problem is NP-hard, computing the function P must 
be NP-hard as well. We now make this argument precise. 

Recall that a protocol is formally a function mapping n, t, and a processor's view 
to a list of the actions the processor should perform, followed by a list of the messages 
it is required to send in the following round. We say that a protocol is communication- 
efficient if in a system of n processors the size of the messages each processor is required 
to send during round I is polynomial in n and £. In the following result we show that the 
problem of computing the function corresponding to a communication-efficient optimal 
protocol is NP-hard. Hence, no such protocol can be computationally efficient. 

Theorem 29: Let P be a communication-efficient, optimal protocol for an admissible, 
practical simultaneous choice C. The problem of computing (the function) P is NP- 
hard. 

Proof: Let E = {E(n,f) : n > t + 2} be the class of systems determined by C and 
a full-information protocol. We will exhibit a Turing reduction from the problem of 
Lemma 28 to the problem of computing P\ that is, given the graph S{p,£) of a point 
(p,t) of a system E(n,i) where n > 2t, we will show how to use P to determine in 
polynomial time whether (p,l) \= M i C M tnabled{a i ). Since C is an admissible, practical 
simultaneous choice, each condition enabled(ai) must be an admissible, practical fact 
within E. It follows by Lemma 28 that determining whether (p,£) (= \l i C i ienabled{a i ) 
is NP-hard. Thus, having exhibited the proposed Turing reduction, we will have shown 
that the problem of computing P is NP-hard. 

Notice that C must be implementable since P is a protocol for C. Thus, Theorem 7 
implies that 7 C is an optimal protocol for C. Let p and f be corresponding runs of J c 
and P, respectively. It follows from the definition of 7 C that (p,£) f= V,- C M enabled(ai) 
iff the nonfaulty processors perform a simultaneous action no later than time I in p. 
Since J c and P are both optimal protocols for C, the nonfaulty processors perform 
simultaneous actions at the same times during p and f. Since n> 2t, there must be at 
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least t + 1 nonfaulty processors in both runs, so the nonfaulty processors simultaneously 
perform an action no later than time £ in either run iff t + 1 processors do so. Therefore, 
(/>>£) |= V ',• C ' M enabled(<n) iff t + 1 processors perform a simultaneous action no later 
than time £ in f . 

One algorithm for determining whether t + 1 processors do perform a simultaneous 
action no later than time £ in f is to construct the view of each processor in f at each 
time A; before time £, and use P to determine when processors are required to perform 
actions. Suppose we have constructed the view of each processor at time k— 1 in f ; let us 
consider the problem of constructing the view of a processor p at time k. Processor p's 
view at (f, A;) consists of p's name, the time k, a list of the messages received by p during 
the first A; rounds of f , and a list of the input received by p during the first k rounds of f . 
Recall that since p is a run of full- information protocol, the graph Q(p, £) is actually an 
encoding of the operating environment during the first £ rounds of p, and hence also 
of f. Given the views of all processors at time k — 1, the protocol P determines what 
messages each processor is required to send to p, and £(/>,£) determines which of these 
messages are actually delivered to p. Since P is communication-efficient, each of these 
messages is of size polynomial in n and k. Furthermore, the input received by p during 
round A; labels the node (p,k) of Q (/>,£). Since C is practical, this input is of constant 
size. Thus, given each processor's view at time A; — 1, we can use the graph £(/>,£) and 
an oracle for P to construct the view of each processor at time A; in polynomial time. 
(An oracle for P is an oracle that, given the view of a processor p at a point (p,£), in 
one step determines what actions P requires p to perform at time £, and constructs the 
messages P requires p to send during round £ + 1.) 

Consider the following algorithm: 

action-performed *— false; 

k <- 0; 

repeat 

for all processors p do 

determine whether P requires p to perform any action at time k, and 
construct the messages P requires p to send during round k + 1; 
endfor 
if t + 1 processors perform actions at time k 

then action^performed <— true; 
k <- k + 1; 
until A; > £ or action-performed; 
if action_per formed 

then halt with "yes" 
else halt with "no". 

From the previous discussion it is clear that given any oracle for P, this algorithm 
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determines in polynomial time whether t + 1 processors perform actions simultaneously 
no later than time £ in f, and hence whether (p,l) f= V,- C M enabled^) . □ 

As an immediate corollary of Theorem 29, we have the following: 

Corollary 30: Let C be an admissible practical simultaneous choice problem. If there 
is a polynomial-time optimal protocol for C, then P=NP. 

Corollary 30 implies that optimal protocols for simultaneous choice problems as 
simple as the distributed firing squad problem or simultaneous Byzantine agreement 
are computationally infeasible in the generalized omissions model, assuming P ^ NP. In 
fact, we do not know whether these problems can be implemented in polynomial time 
even using an NP oracle. The best we can do in the generalized omissions model is im- 
plement them using polynomial-space computations, as in the proof of Theorem 10. We 
consider the question of determining the exact complexity of implementing admissible 
practical simultaneous choice problems in this model an interesting open problem. 

We now proceed to prove Lemma 28. First, however, we state a result that will 
be very useful in the proof of Lemma 28. Roughly speaking, it says that if a group of 
processors can (jointly) prove that they are nonfaulty, then their views become common 
knowledge at the end of the following round. 

Lemma 31: Let S be a set of processors and let 5 = P — S. Let p be a run of a 
full-information protocol. If the processors in S implicitly know at (p, £ - 1) that 5 
contains t faulty processors, then the joint view of S at (/j,£ - 1) is common knowledge 
at (p,£). 

Proof: Let <p = U V is the joint view of S at time £ - 1", where V = v(S,p,£- 1). 
Suppose (p',£) \= (p. Given that S has the same (joint) view at (/>,£ - 1) and at 
(/>',£- 1), and since S implicitly knows at (/>,£- 1) that 5 contains t faulty processors, 
S implicitly knows the same at (p',l - 1). In particular, the processors in S must 
be nonfaulty in p' and each must successfully send its view to all processors during 
round £ of p', and since all nonfaulty processors will receive these messages, we have 
(p',£) (= E M <p. It follows that ip D E M ip is valid at time £, and the induction rule 
implies <p ^ C M <p is valid at time £ as well. Thus, (p,£) (= <p implies (/>,£) f= C M tp. □ 

(We note in passing that a converse to Lemma 31 is also true: If the joint view at 
time £ — 1 of a set S of processors is common knowledge at time £, then the processors 
in some set S' D S must implicitly know at time £ — 1 that there are t faulty processors 
among the members of S .) 

In addition to Lemma 31, the following result, analogous to Lemma 11 in the 
omissions model, will be of use in the proof of Lemma 28. 
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Lemma 32: Let p and p' be runs differing only in the (faulty) behavior displayed by 
processor p after time k, and suppose no more that / processors fail in either p or p'. 
Hl-k<t + l-f, then {p,e) ~ (p',£). 

Proof: The proof is analogous to the proof of Lemma 11, with the added observation 
that if p sends no messages after (an arbitrary) time k in f, then (f,£) ~ (f',£) where f' 
differs from f in that p receives messages from an arbitrary set of processors during 
round k. □ 

As we have already mentioned, the proof of Lemma 28 involves a reduction from 
the Vertex Cover problem (cf. [GJ]). This is the problem of determining, given a graph 
G = (V, E) and a positive integer k, whether G has a vertex cover of size k or less; that 
is, a subset V C V such that | "V | < k and, for each edge {v,w} G E, at least one of v 
and w belongs to "V. 

Theorem [Karp]: Vertex Cover is NP-complete. 

We now prove Lemma 28. 

Proof of Lemma 28: We will exhibit a Turing reduction from Vertex Cover to 
the problem of testing for common knowledge of <p lt . . . , <p a , and it will follow that this 
problem is NP-hard. Since every graph G = {V,E) is |V|-coverable, the following is an 
algorithm for Vertex Cover: 

m<-|H- 

while G has no vertex cover of size m — 1 do 

m <— m — 1; 
if m < k 

then return U G has a vertex cover of size k" 

else return "G has no vertex cover of size k". 



To implement this test, it is enough to implement a test that, given an m-coverable 
graph G, determines whether G is not (m — l)-coverable. Every graph G = (V, E) 
clearly has a vertex cover of size |V| — 1. In addition, it is possible to determine 
whether G has a vertex cover of size |V| — 2 in polynomial time. Similarly, it is easy 
to determine whether G has a vertex cover of size in polynomial time. We show that 
ifl<m<|V| — 2 and G is m-coverable, then it is possible to construct in polynomial 
time a graph Q{p, £) such that (p, I) f= V< C M <pi iff G is not (m- l)-coverable. The point 
(p, I) will be a point of a system E(n, t) with n > 2t from the class under consideration. 
Thus, given an oracle for testing for common knowledge of <p u . . . ,<p„, we will have a 
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polynomial-time test for the (m - l)-coverability of G. It will follow that testing for 
common knowledge of <p x , . . . , <p t is NP-hard. 

Fix a graph G = {V,E) and an integer m satisfying 1 < m < |V| - 2. Let n = 
|V| + m+3 and* = m+2, and let £(n,i) be a system from the class under consideration. 
Notice that since |V| > m + 2, we have n > 2t. Since each fact ipt is admissible, we 
can explicitly construct in polynomial-time a labeled communication graph (of a point 
in E(rM)) of minimal length determining &. Of these graphs, let Q be one of minimal 
length, say of length k. Let p be a run of £(n,<), illustrated in Figure 5, satisfying 
the following conditions: (i) the input received in the first k rounds of p is the same 
as in Q, and no input is received after time k; (ii) all messages in the first k rounds 
are delivered; (iii) in round k + 1, the only undelivered messages are as follows: no 
message is delivered from processor p v to p w in round k + 1 of p iff there is an edge 
from v to w in G (that is, the graph G is represented by the undelivered messages 
during round A; + 1); (iv) two additional processors f x and f 2 are silent from time k + 1 
in p, and all other messages after time A; + 1 are delivered; and (v) a set S of t + 1 
additional processors do not fail in p. Since G has a vertex cover V of size m, one failure 
pattern consistent with the undelivered messages in p is that p v is faulty for every v £ "\> 
(accounting for the undelivered messages during round k + 1 of p) and that both /i 
and / 2 are faulty. Given that t = m + 2 processors fail in this failure pattern, there 
is a run p of E(n,t) satisfying the required conditions. Since the graph Q determining 
the input of Q{p,k) can be constructed in polynomial time, setting £ = k + 3, the 
graph Q{p,t) can be constructed in polynomial time as well. It remains to show that 
(p,l) |= V; C M <pi iff G is not (m - l)-coverable. 

Suppose G has no vertex cover of size m - 1, and let F be the set of processors 
failing in p. Since /i and f 2 must be faulty (each fails to the t + 1 processors in S), 



def 



F' = F — {fi,fz} must account for every undelivered message during round k + 1. 
If there is an edge from v to w in G, then no message from p v to p w is delivered in 
round k + 1, and one of p v or p w must be in F'. It follows that F' must induce a vertex 
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cover of G. Since G has no vertex cover of size m — 1, F' must contain at least m 
processors, and F at least t = m + 2. Thus, the processors in S implicitly know at time 
k + 2 that their complement S = P - S contains t faulty processors. By Lemma 31, 
their views at time k + 2 must be common knowledge at time k + 3. These views 
contain a complete description of Q(p,k), and hence the identity of Q(p,k) is common 
knowledge at (p,l). Recall that Q was chosen to be a graph determining <p { for some i. 
If g does not specify a failure, then §(p, k) = Q, and it follows that (p,t) f= C M (p { . On 
the other hand, if Q does specify a failure, then <pi is determined by the input to the 
first k rounds of Q and the existence of a failure. Notice that the failure of f x and / 2 is 
also recorded in the view of S at time k + 2, and hence is also common knowledge at 
(/>,£). Thus, the existence of a failure is common knowledge at time £, and it follows 
that (p,l) \= C M <pi. In either case, we have (p,t) |= V,- C M <pi. 

Conversely, suppose G does have a vertex cover of size m - 1. Without loss of 
generality, at most * - 1 processors fail in p. First, we claim that (p,l) ~ (f,£) where f 
is a failure-free run with the input of p. Since /i and f 2 fail only after time k + 1 = t- 2, 
two applications of Lemma 32 imply that (p, £) ~ (p',l) where p' differs from p in that f x 
and f 2 do not fail in p'. Since at most t - 3 processors fail in p' and k = £ - 3, by 
Lemma 32 we have (p',£) ~ (f,£). Second, we claim that for each <p { there is a run rji 
not satisfying ip { that differs from Q only after time k - 1. If jfc = 0, then since £>< 
is admissible and hence not valid in the system, such a run must certainly exist. On 
the other hand, if k > 0, then since Q was chosen to be a labeled communication 
graph of minimal length determining <p } - for some ipj, such a run must exist in this 
case as well. Now, let ri\ be a run having the input of 77,-, in which no processor 
fails before time £, and in which processors become silent after time £ iff there is a 
failure in 77,-. Since <pi is a fact about the input and existence of failures, and since r?,- 
does not satisfy <p { , neither does 77? . Let f and f\\ be runs of 7 in the omissions model 
having the operating environment of f and rj'^ respectively. (Notice that these operating 
environments are actually operating environments of the omissions model.) Notice that 
no processor fails before time £ in either § or ft. It follows that G(f,£) = G($,£), and 
that k($,£) = A;(j7-,£). We denote them by G and k, respectively. Since t = m + 2 
and m > 1, we have that t > 3. Thus, k = I - (t + 1) <l-4 = k-l. Recall 
that f and ft have the same input (and no failures) through time k — 1. It follows 
that V{$,1) = V(ft,£). It follows by Lemma 19 that (f,£) ~ (ft, £) in the omissions 
model, and hence that (f,£) ~ (ft, I) in the generalized omissions model as well. Since 
{P>£) ~ (?,*), it follows that for each <p t we have (p,t) ~ (^,£) and (rj\, £) £ y?,-. 
Therefore, for each <p,- we have (/>,£) J£ C^p,-, and hence (p,t) Y= Vi C^^. □ 

We have seen that, as a result of the uncertainty about the failure pattern, the com- 
plexity of determining whether admissible facts are common knowledge is dramatically 
greater in this model than in more benign models. It is conceivable, however, that this 
gap in complexity is due to the fact that faulty processors may fail both to send and 
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to receive messages, and not merely due to the uncertainty about the failure pattern. 
We can show, however, that it is precisely due to this uncertainty that we observe this 
complexity gap. Consider the closely related failure model we have termed generalized 
omissions with information, a model differing from the generalized omissions model in 
that a processor not receiving a message can determine whether it or the sender is at 
fault. We can show that the construction used in the omissions model may also be 
used in this model to yield a set of views V(p, I) completely characterizing what facts 
are common knowledge at the point (p,£). 

Proposition 33: In generalized omissions with information, we have (p,i) (= C M <p 
iff {p',i) \= <p for all p' satisfying V{p',l) = V{p,t). 

All of the proofs in the omissions model hold when generalized to this model, with 
the exception that the construction must be started with a nonfaulty processor. (In 
particular, Lemma 16 holds only when the processors p and q are processors that do not 
fail to receive messages.) This exception says that faulty processors may not be able to 
perform all actions performed by the nonfaulty processors, but this is no surprise since 
the same is true in the receiving omissions model. Furthermore, the computation of the 
sets Bi in the construction now depends not only on the undelivered messages, but also 
on the additional information that receiving processors obtain regarding blame for the 
undelivered messages. As in the omissions model, this construction yields a method of 
deriving efficient tests for common knowledge of certain facts. Thus, it is again possible 
to design efficient optimal protocols: 

Theorem 34: Let C be an implementable practical simultaneous choice. In general- 
ized omissions with information, there is a polynomial-time optimal protocol for C. 

This shows that it is precisely the uncertainty about the failure pattern that is respon- 
sible for the observed gap in complexity, and not merely the fact that faulty processors 
may fail both by failing to send and to receive messages. 

The uncertainty about the failure pattern in the generalized omissions model adds a 
new combinatorial structure to the similarity graph in this model that does not exist in 
other variants of the omissions model. Since it is possible to assign failure to processors 
in a number of different ways consistent with a pattern of undelivered messages, it is 
possible to play "pebbling games" with the failure pattern when constructing paths in 
the similarity graph, showing that one point is similar to another point by alternatively 
assigning responsibility for undelivered messages to the sender and to the receiver. In 
fact, in addition to increasing the difficulty of determining whether a fact is common 
knowledge at a point, the following theorem shows that the this new combinatorial 
structure has interesting effects on when facts become common knowledge. 
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Theorem 35: In the generalized omissions model: 

a. If n < 2t then the only facts that are common knowledge at time 2 are facts valid 
at time 2. 

b. If n > 2t then some facts not valid at time 2 do become common knowledge at 
time 2. 

Proof: For part (a), it is enough to show that (p,2) ~ (p',2) for all runs p and p'. 

First we show that (p,2) ~ (77,2) where r\ is the failure-free run with the input 
of p, and that (p',2) ~ (77', 2) for the analogous failure-free run 77' with the input of p'. 
Suppose that B and G are the sets of faulty and nonfaulty processors, respectively, in p. 
Without loss of generality, we may assume that |JB| < t and \G\ < t. Using Lemma 32, 
we see that (p, 2) ~ (f,2) where f differs from p in that processors in B are silent 
during round 2 of f. The view of G at (f,2) is independent of the view of B at (f, 1), 
so (f>2) ~ (f',2) where f' differs from f in that processors in B receive messages from 
all processors during round 1 of f'. Again, using Lemma 32, we see that (f',2) ~ (f",2) 
where f" differs from f' in that processors in B do not fail in round 2 of f". The only 
failures remaining in f " are failures of processors in 5 to send to processors in G during 
round 1. It is therefore possible to reverse the roles of B and G in this argument to 
show that (f",2) ~ (77,2) where 77 is the failure-free run with the input of f" (and of 
hence p). By the transitivity of "~," (p,2) ~ (r?,2). An analogous argument shows 
that (p',2) ~ (17', 2). 

Now we show that (77,2) ~ (77', 2) for all failure-free runs 77 and 77'. Silence the 
processors in a set B oft processors during the run 77 to yield a run f, and silence 
the processors in the set B' — P — B of the remaining processors during the run 77' to 
yield a run f'. By the previous paragraph, (77,2) ~ (f,2) and (77', 2) ~ (f',2). Change 
the input received by processors in B during the run f to that received in f' to yield 
a run £, and change the input received by processors in B' during the run f' to that 
received in f to yield a run f. Clearly, (f,2) ~ (£,2) and (f',2) ~ (£',2). In addition, 
by the previous paragraph, (f,2) ~ (f',2). Thus, (77,2) ~ (??',2), as desired. 

For part (b), let B = {p l5 . . . ,p t } and G = {p t+1 , . . . ,p n }. Let <p be the fact "each 
processor in B fails to send to every processor in G during round 1." We show that 
<p D C M <p is valid at time 2. Notice that -xp D -<C M <p and ->C M (p D C M {-<C M <p) are 
valid. Since, as we shall soon show, <p Z> C M <p is valid at time 2, so are -^C M <p D -«p 
and C M (^C M (p) D C^(-.^). It follows that -up D C^(->^) is also valid at time 2. Thus, 
either <p or -.v 3 is common knowledge at time 2, yet neither is valid at time 2. Now, 
let p be a run satisfying ip. Since n > 2t , there are at least t + 1 processors in G, and 
none of them receives a message from any of the t processors in B during round l,soG 
implicitly knows at time 1 that B contains t faulty processors. By Lemma 31, the joint 
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view of the processors in G at time 1 is common knowledge at time 2. Since <p follows 
from the joint view of G at time 1, <p is common knowledge at time 2. Thus, <p D C^ip 
is valid at time 2. □ 

As a result of Theorem 35, when n < 2t no nontrivial simultaneous choice can 
be performed at time 2 in this model. We remark that this is the first evidence of 
behavior in such a benevolent failure model depending on the ratio of n and t. In 
addition, Theorem 35 tells us that nonvalid facts do not become common knowledge 
at time 2 if n < 2t, yet we know that such facts do become common knowledge in 
more benign models. As a consequence, protocols that are optimal in the generalized 
omissions model will not be optimal in the omissions model, or even in the generalized 
omissions model with information. 

The generalized omissions model therefore seems to be a natural failure model that 
already displays some of the complex behavior of the more malicious models, while still 
involving only benevolent processors that faithfully follow their protocols. We believe 
that this model is therefore a natural candidate for further study as an intermediate 
model on the way to understanding the mysteries of fault tolerance in truly malicious 
failure models. 



7 Conclusions 

This paper applies the theory of knowledge in distributed systems to the design and 
analysis of fault-tolerant protocols for a large and interesting class of problems. This is 
a good example of the power of applying reasoning about knowledge to obtain general, 
unifying results and a high-level perspective on issues in the study of unreliable systems. 
We believe that reasoning about knowledge will continue to be an effective tool in 
studying the basic structure and the fundamental phenomena in a large variety of 
problems in distributed computing. 

Given the effectiveness of a knowledge-based analysis in the case of simultaneous 
actions (see also [DM]), it would be interesting to know whether such an analysis can 
shed similar light on the case of eventually coordinated actions. Dolev, Reischuk, and 
Strong show that the problem of performing eventually coordinated actions in such 
synchronous systems is quite different from that of performing simultaneous actions 
(cf. [DRS]). In addition to common knowledge, an analysis of eventually coordinated 
actions may be able to make good use of the notion of eventual common knowledge 
(cf. [HM], [Mo]). We note that it is possible to show that for eventual choice problems 
there do not, in general, exist protocols that are optimal in all runs. For example, 
one can give two protocols for (eventual) Byzantine agreement with the property that 
for every operating environment one of these protocols will reach Byzantine agreement 
(i.e., all processors will decide on a value) by time 2 at the latest. However, if t > 1, 
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it is well known that no single protocol can guarantee that agreement will be reached 
by time 2 in all runs. What is the best notion of optimality that can be achieved in 
eventual coordination? 

We provide a method of deriving an optimal protocol for any given implementable 
specification of a simultaneous choice problem. However, in this work, we have com- 
pletely sidestepped the interesting question of characterizing the problems that are and 
are not implementable in different failure models. We believe that a general analysis 
of the implementability of problems involving coordinated actions in different failure 
models will expose many of the important operational differences between the mod- 
els. As an example, our specification of the distributed firing squad problem in the 
introduction is implementable in the variants of the omissions model, but is not imple- 
mentable in more malevolent models, in which a faulty processor can falsely claim to 
have received a "start" message and otherwise seem to behave correctly (see [BL] and 
[CDDS] for definitions of versions of the firing squad problem that are implementable 
in the more malicious models). 

In the generalized omissions model, we have shown how to derive optimal pro- 
tocols for nontrivial simultaneous choice problems, requiring processors to perform 
polynomial-space computations between consecutive rounds. We have also shown an 
NP-hard lower bound for any communication-efficient protocol for such a problem that 
is optimal in all runs. Determining the precise complexity of this task is a nontrivial 
open problem, due to the interesting combinatorial structure underlying the generalized 
omissions model. It would also be interesting to extend our study to more malicious 
failure models, such as the Byzantine and the authenticated Byzantine models (cf. [F]). 
It is not immediately clear whether the notion of a failure pattern can be defined in 
these models in a protocol-independent fashion. Thus, it is not clear that the notion 
of optimality in all runs is well defined in such models. If such definitions are possible, 
we believe that the NP-hardness result from the generalized omissions model should 
extend to these models. (Our proof does show that testing for common knowledge in 
runs of the full-information protocol 7 in both models is NP-hard.) Capturing the pre- 
cise combinatorial structure of the similarity graph in these models is bound to expose 
many of the mysterious properties of the models. We believe that this is an important 
first step in understanding these models. 

As we have seen, there are no computationally-efficient optimal protocols for simul- 
taneous choice problems in the generalized omissions model. Since it is unreasonable 
to expect processors to perform NP-hard computations between consecutive rounds of 
communication, it is natural to ask what is the earliest time at which such actions can 
be performed by resource bounded processors (e.g., processors that can perform only 
polynomial-time computations). Are there always guaranteed to be optimal protocols 
for such processors? How can they be derived? The analysis of this question is no 
longer as closely related to the question of when facts about the run become common 
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knowledge. It seems that the information-based definition of knowledge that we pre- 
sented in Section 3, used in many other papers as the definition of knowledge in a 
distributed system (cf. [CM], [DM], [FI], [HM], and [PR]), is not appropriate for rea- 
soning about such questions. A major challenge motivated by this is the elaboration 
of the definition of knowledge presented in Section 3 to include notions of resource- 
bounded knowledge that would provide us with appropriate tools for analyzing such 
questions. Such a theory would provide notions such as polynomial-time knowledge and 
polynomial-time common knowledge, which would correspond to the actions and the 
simultaneous actions that polynomial-time processors can perform. Note that the fact 
that (suboptimal) polynomial-time protocols for the simultaneous Byzantine agreement 
problem exist even in the more malicious failure models imply that, given the right no- 
tions, many relevant facts should become polynomial-time common knowledge. Much 
work is left to be done. 
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